Method of and apparatus for translating shipping documents

ABSTRACT

A method of translating a shipping document regarding one or more shipment items being shipped, tracked and delivered to a final destination using a Web-based shipping, tracking, and delivery information network. At the point of shipment pickup, the method involves digitally imaging an original shipping document (or shipping label) in connection with a shipment, at one or more image resolutions. The bar-coded shipment tracking number graphically represented in the original shipping document is automatically read, and its character data string is automatically encoded into the header of the corresponding digital image file and/or the name of the digital image file. While the shipment is being delivered to the first scanning point in the network, the digital image file is transmitted over a wireless communication link to one or more digital image processing application servers supported on the network. The digital images are processed so that shipping information contained in the digital images (and indexed with the original shipment tracking number) is automatically abstracted/recognized, and loaded into the shipping information RDBMS maintained on the network. When the delivered shipment arrives at the first scanning point in the network, the bar-coded shipment tracking number (contained in the original shipping document) is read, and corresponding shipping information maintained in an RDBMS is accessed. A unique network-assigned shipping label is automatically generated, and the unique network-assigned shipping label is applied to the shipment items at the first scanning point in the network, for use in managing future services supported on the network.

RELATED CASES

This is a Continuation of U.S. application Ser. No. 11/654,483 filedJan. 17, 2007; said Application being incorporated herein by reference.

BACKGROUND OF INVENTION

1. Field of Invention

The present invention relates to improvements in shipping, tracking anddelivering package, envelope, freight and cargo shipments, as well ascommunicating and managing shipping information across the globe, inways which significantly increases the velocity of shipping informationacross the network, and reduces delivery time, and thereby improvingaccess and enabling the reaching of goals that improve currentconditions and future prospects.

2. Brief Description of the State of the Art

As described in the landmark study, “How Greater Access Is Changing TheWorld”, conducted by SRI International and sponsored by Federal Express,the concept “access” is defined as the catalytic process that enablesinteractions, contacts, and exchanges among people, businesses, andnations. While markets represent platforms for transactions to takeplace, access provides the means for markets to operate. Gaining accessenables us to reach goals that improve our current condition and futureprospects. Those with access to what they need or desire can achievetheir aspirations, and those without such access will inevitably fail toreach their full potential. Access indicates ability—the ability toaccomplish a broad range of actions, from attaining physical presence tocommunicating, and from acquiring to using. Access also impliesconnection, which has profound implications for the way we conduct ourlives, businesses, and governments.

Over the past three centuries, access has had a measurable impact onpeople's lives, business development cycles, and the economic growth ofnations. Individuals once had access only to those things within walkingdistance. As a result, their choices and capabilities were severelyconstrained by lack of access. A major reason for the emergence andgrowth of villages and towns was the desire of inhabitants to gainaccess—access to others, to security, to specialized trades, and toother factors associated with human commerce and interaction. Astransportation systems, technologies, and communications capabilitiesevolved and networks expanded in breadth and sophistication, degrees ofaccess continuously increased. These changes led to the creation ofadvanced civilizations and, eventually, to the integration of allsocieties into a global society.

Levels of access are by no means uniform, but rather vary significantlyamong individuals, nations, and substantive areas (e.g., products,services, information, etc.). Nevertheless, the march towardcontinuously greater access is accelerating and inevitable. For example,within just a few years after the invention of computers and theInternet, we are rapidly approaching near-perfect access to certaintypes of information. The introduction of innovations to transmitphysical objects and information has resulted in increasing access,which has risen exponentially in recent years.

While every generation has witnessed improvement in access, and futuregenerations are expected to have even more access than we have now,people today benefit from a unique level of access to physical things,to information, and to each other. The expectations, behavior, and powerof access are exerting profound changes in the ways in which people,businesses, communities, and nations operate, giving rise to bothconsiderable challenges and major opportunities.

As described in “How Greater Access Is Changing The World”, the processof generating access revolves around three functional variables: space,time, and information.

Space represents the distance between the entity seeking access and the“thing” (physical or informational) being sought. It involves geographyand the physical locations of supply and demand. Supplies that arenearby are normally easier to access than those in distant locations.Access dramatically reduces the economic constraint of geographicdistance and allows entirely new patterns of production, consumption,and economic development.

Time centers on the amount of time required to obtain that which isbeing sought. Access not only creates the ability to obtain goods,services, information, etc., in an increasingly short period of time,but also allows the orchestration of delivery, meaning delivery in thespecific time horizon desired by the user/customer. Both time-relatedchanges have profound implications for consumer and producer behavior.

Information is anything that reduces uncertainty. Since uncertaintyaffects the consequences of decisions, information aids decision-makingby helping one to choose between alternatives. Information may be in theform of facts, opinions, or algorithms that are capable of beingtransmitted and reproduced. Increasingly, information is available indigital form.

At its core, access can be explained in the following formula, f (T, S,I)=A, wherein access (A) is a function of time (T), space (S), andinformation (I).

Achieving access is determined by each of these parameters, or“independent variables.” In various ways, these parameters collectivelyestablish degrees of access:

(1) One consequence of increasing access is the reduction of timerequired to gain access, thus increasing available time. Access alsofacilitates the orchestration of products and services provision so thatconsumers/users are able to obtain what they desire in the timeframethey prefer, rather than the timeframe convenient for the producer ordeliverer;

(2) If the desired object is physically located out of one's reach, thenaccess will be denied. Improved access has the effect of collapsingspace (or alternatively, increasing usable space, since actors canoperate effectively within larger areas); and

(3) Without information about the existence or location of the desiredobject, then one will not obtain it. Increasing information generallyexpands degrees of access.

Thus, “access” is generated by reducing time and space, and by providingrelevant shipping and billing information to customers anywhere andanytime throughout the world. The degree of access generated on apackage shipping, tracking and delivery network depends upon the degreeof reduction in time and space and the level of information provided.

The need to reduce time and space in the shipping industry to improveaccess and gain competitive advantage has created great incentives forinternational couriers to develop powerful Internet-based shipping,tracking and delivery networks designed to process package informationand deliver packages to their destinations, faster and more efficientlythan their competitors.

In FIG. 1, there is shown a state-of-the-art conventional Internet-basedglobal-extensive shipping, tracking and delivery network 1. Asillustrated by the network GUI screens of FIGS. 2A1 through 2B6, thisstate-of-the-art Web-based shipping, Tracking and Delivery Networkoffers shippers and customers several flexible methods of shipping andtracking, and monitoring customs clearance of package/envelope andfreight shipments (via ground and air transportation) as well asimmediate notification about clearance delays, attempted deliveries,proofs of delivery, etc via email, Internet, or wireless methods, withand without use of shipment tracking numbers.

In particular, one or more shipments can be scheduled for pickup by wayof several optional services supported on the network of FIG. 1,including (i) packages/envelope shipments that are scheduled for thesame-day or next-day pickup, (ii) ground shipments that are scheduledfor pickup on the next business day, or any business day up to two weeksin advance, (iii) freight shipments (over 150 lbs) that are scheduledfor pickup, and the like.

As shown in FIG. 2B1, package/envelope shippers can (i) trackpackage/envelope shipments using the system's shipment tracking number(or Door Tag Number) to receive immediate notifications about clearancedelays, attempted deliveries, proofs of delivery, etc via email,Internet and/or wireless methods, (ii) track package/envelope shipmentsusing the shipper's account number and address to receive immediatenotifications about clearance delays, attempted deliveries, proofs ofdelivery, etc via email, Internet and/or wireless methods, withoutproviding the system a tracking or reference number, and (iii) trackpackage/envelope shipments using an alternative reference (i.e. enteringthe account number and/or the address of the shipper) and display thecurrent status of all shipments matched to the account number and/oraddress, monitor all shipments through reliable status updates for allincoming, outgoing and third party shipments, and receive immediatenotification about clearance delays, attempted deliveries, proofs ofdelivery, etc via email, Internet, or wireless methods.

The U.S. Government can track military shipments using the FederalGovernment's (e.g. military shipper's) Transportation Control Number(TCN), and display the current status of all shipments matched to theaccount number and/or address, monitor all shipments through reliablestatus updates for all incoming, outgoing and third party shipments, andreceive immediate notification about clearance delays, attempteddeliveries, proofs of delivery, etc via email, Internet, or wirelessmethods.

Also, cargo shippers can track cargo shipments using Cargo TrackingNumbers (including carrier identification) and display the currentstatus of all shipments matched to the account number and/or address,monitor all shipments through reliable status updates for all incoming,outgoing and third party shipments, and receive immediate notificationabout clearance delays, attempted deliveries, proofs of delivery, etcvia email, Internet, or wireless methods.

However, as illustrated in FIG. 3, even with such advanced shipping,tracking and delivery information management capabilities supported onthe conventional network of FIG. 1, shipments which do not bearnetwork-assigned shipping labels, cannot be processed until they arepicked up and driven to the first scanning point in the network (e.g.shipping and delivery terminal, or sorting and routing hub), at whichthey are relabeled at a package labeling station through a tediousprocess requiring the reading of original shipping documents, thegeneration of new network-assigned labels bearing bar-coded shipmenttracking numbers, and the application of these printed labels onto thepackages. It cannot be overstated that this package re-labeling processrequires a significant amount of time, causes significant delays inshipment delivery, and significantly increases the overall cost ofshipment delivery, world over.

Recently, US Patent Publication No. 20006/0158678 to Angrick disclosedan automated document image capture and processing system, for capturinga 2D image of shipping documents at the point of pickup, compressingproduced digital images, and transmitting digital images of shippingdocuments to a predetermined processing center. While the disclosed roleof such point-of-pickup shipping document image capture and transmissionis to reduce the delay in processing such documents, and thus lessen theburden on the truck driver (e.g. including delayed or refused payments,delayed or missed shipping opportunities and the like), there is nospecific disclosure, teaching or suggestions in this prior art patentpublication on how such point-of-pickup image capture of andtransmission can, will or might help improve the operational efficiencyof conventional Internet-based shipping, tracking and delivery networks,and the various services currently supported thereover.

Thus there is a great need in the art for an improved method of andmeans for capturing, transmitting and processing digital images ofpackage/envelope and freight/cargo shipping information, as well asefficiently and rapidly delivering such shipments to their destinations,within an improved Web-based shipping, tracking and delivery network, soas to overcome the shortcomings and drawbacks of prior artmethodologies, systems and apparatus.

OBJECTS AND SUMMARY OF THE PRESENT INVENTION

Thus, it is a primary object of the present invention to provide animproved method of and apparatus for capturing, transmitting andprocessing digital images of package, envelope and freight/cargoshipping documents as well as the efficient delivery of such shipments,within an improved Internet-based (e.g. Web-based) shipping, trackingand delivery network, while avoiding the shortcomings and drawbacksassociated with prior art systems and methodologies.

Another object of the present invention is to provide a globalInternet-based Web-based shipping, tracking, and delivery network,wherein the operating theme underlying all of its activities is timesensitivity, such that all equipment, technologies, human resources, andsystems are combined to accelerate the velocity of packages andinformation, not only to collapse time for delivery to a minimum, butalso to guarantee time-definite delivery.

Another object of the present invention is to provide such a globalWeb-based shipping, tracking, and delivery network, wherein space iscontinuously collapsed through the extension of the network, and byreducing the amount of time needed to move packages and freight aroundthe world.

Another object of the present invention is to provide a global Web-basedshipping, tracking, and delivery network, wherein customers havetransparent access to timely captured and processed shippinginformation, throughout the entire supply chain, thereby revolutionizingbusiness models.

Another object of the present invention is to provide a global Web-basedshipping, tracking, and delivery network supporting the capture ofshipping document images and recognition-processing thereof initiatedfrom the point of pickup and completed while shipments are transportedto the first sorting and routing hub of the network so as tosignificantly increase velocity of shipping information through thenetwork, and reduce delivery time over the network.

Another object of the present invention is to provide a global Web-basedshipping, tracking and delivery network employing client-side andserver-side image processing techniques for recognizing and extractinginformation contained in shipping document images so as to significantlyincrease velocity of shipping information through the network, andreduce delivery time over the network.

Another object of the present invention is to provide such a globalWeb-based shipping, tracking, and delivery network, which uses advanceddigital image capture, processing and transmission processes at thepoint-of-package pickup so as to expedite the processing of digitalimages of shipping documents (e.g. manifests, way bills, bills oflading, air bills, etc) and the recognition of shipping informationcontained therein which is entered in a shipping information database(RDBMS) of the network, available for access and use at a time when thecorresponding package physically arrives at first scanning point (e.g.pickup and delivery terminal or sorting and routing hub) in the network.

Another object of the present invention is to provide such a globalWeb-based shipping, tracking, and delivery network, wherein eachpackage, envelope and/or freight pickup/delivery vehicle is equippedwith a mobile image capture and processing (MICAP) system employing atwo-dimensional imaging array, an integrated illumination source, and anRFID tag reader.

Another object of the present invention is to provide such a globalWeb-based shipping, tracking, and delivery network which allows customsclearance processing to start immediately following package pickup, andthe capture, processing and transmission of digital images of theoriginal shipping document associated with the shipment.

Another object of the present invention is to provide such a globalWeb-based shipping, tracking, and delivery network, wherein errors inshipping document paperwork can be addressed before the courier returnsto first scanning station (i.e. pickup and delivery terminal or sortingand routing hub) and while the customer is available.

Another object of the present invention is to provide a global Web-basedshipping, tracking, and delivery network, wherein at its first scanningpoint in the network, the bar-coded shipment tracking number containedin the original shipping label is read using an optical scanning deviceor an imaging-based bar code reading device, so as to access shippinginformation stored in the RDBMS corresponding to the shipment.

Another object of the present invention is to provide a global Web-basedshipping, tracking, and delivery network, wherein the electronic datafiles of captured digital images of shipping documents are automaticallyencoded with the original shipment tracking number, while the electronicdata file is named or titled using the same original shipment trackingnumber.

Another object of the present invention is to provide such a globalWeb-based shipping, tracking, and delivery network, wherein the role ofthe image processing application servers and human-operated data-keyingworkstations is to expedite the processing of such digital images, therecognition of shipping information graphically encoded with receiveddigital image files (e.g. employing automatic form and characterrecognition processes, and human intelligence when needed), andultimately storing the extracted shipping information in the shippinginformation RDBMS on the network, while the pickup/delivery vehicle istransporting the package from its point of pickup to its first scanningpoint in the network.

Another object of the present invention is to provide a global Web-basedshipping, tracking, and delivery network, wherein electronic data filesof captured digital images of shipping documents are automaticallyencoded with both automatically recognized original shipment trackingnumber(s) as well as shipping information contained in the originalshipping document, while the electronic file is named or titled usingthe shipment tracking number.

Another object of the present invention is to provide a global Web-basedshipping, tracking, and delivery network which makes efficient usepackage transport time (i.e. measured from the time of pickup to arrivalat its first scanning point), wherein digital image capture/processingand package transport operations are performed in a parallel manner,namely, the processing digital images of shipping documents, extractingof shipping information graphically represented said digital images,loading extracted shipping information into a shipping informationRDBMS, while the shipment is still in transit on a pickup/deliveryvehicle to its first scanning point, and thereby facilitating rapidrelabeling of a shipment with a machine readable code (e.g. 1D barcodesymbol, 2D barcode symbol, EPC-based RFID tag, etc.) at its firstscanning point in said network, early customs clearance of the shipment,and early billing thereof.

Another object of the present invention is to provide such a globalWeb-based shipping, tracking, and delivery network, wherein according toa first illustrative embodiment of the present invention, after readingthe original shipment tracking number at a first scanning point in thenetwork and accessing the RDBMS, a unique network-assignedmachine-readable shipping label, comprising a 2D barcode symbol and/oran RFID tag (encoded with a unique network-assigned intelligent shipmenttracking number as well as package shipping information abstracted fromthe original shipping document) is generated, and then applied to thepackage; and thereafter at subsequent sorting and routing hubs in thenetwork, the intelligent machine-readable label is read so as to accessshipping information encoded therein and sort and route the packagethrough the network to its intended destination indicated by theshipping information contained in the intelligent machine-readablelabel.

Another object of the present invention is to provide such a globalWeb-based shipping, tracking, and delivery network, wherein according toa second illustrative embodiment of the present invention, after readingthe original shipment tracking number at the first scanning point in thenetwork and accessing the RDBMS, the unique network-assignedmachine-readable shipping label, comprising a 1D bar-ode symbol and/oran RFID tag (encoded with unique network-assigned shipment trackingnumber), is generated and applied to the shipping label to the package;and thereafter at subsequent sorting and routing hubs in the network,the shipment tracking number contained in the unique network-assignedmachine-readable shipping label is read to access the RDBMS, andshipping information stored in the RDBMS is then used to sort and routethe package through the network to its intended destination indicated inthe RDBMS.

Another object of the present invention is to provide a global Web-basedshipping, tracking, and delivery network, wherein according to a thirdillustrative embodiment of the present invention, after reading theoriginal shipment tracking number (encoded in a machine-readable label)at the first scanning point in the network to access the RDBMStherewith, shipping information stored in the RDBMS is used to sort androute the package through the network to its intended destinationindicated in the RDBMS.

Another object of the present invention is to provide an Internet-basedshipping, tracking, and delivery network supporting a plurality ofdigital image capture and processing instruments deployed aboard aplurality of pickup/delivery vehicles, wherein each digital imagecapture and processing instrument can upload digital images of shippingdocuments wirelessly to a cellular telephone which, in turn, transmitsthe digital images to one or more application servers and/orhuman-operated data-keying workstations supported on the network formachine and/or or human-assisted recognition-processing, and acquisitionof shipping information contained in the digital images and the entry ofthe shipping information into an RDBMS maintained on the network for thepurpose of supporting its shipping, tracking, and delivery operations.

Another object of the present invention is to provide an Internet-basedshipping, tracking, and delivery network supporting a plurality ofdigital image capture and processing instruments deployed at a pluralityof pickup and delivery terminals, wherein the digital image capture andprocessing instrument can upload digital images of shipping documents toone or more application servers and/or human-operated data-keyingworkstations supported on the network for machine and/or orhuman-assisted recognition-processing, and acquisition of shippinginformation contained in the digital images and the entry of theshipping information into an RDBMS maintained on the network for thepurpose of supporting its shipping, tracking, and delivery operations.

Another object of the present invention is to provide an Internet-basedshipping, tracking, and delivery network supporting a plurality ofmobile digital image capture and processing instruments deployed on aplurality of pickup and delivery couriers, wherein each said mobiledigital image capture and processing instrument can upload digitalimages of shipping documents wirelessly to one or more applicationservers and/or human-operated data-keying workstations supported on saidnetwork for machine and/or or human-assisted recognition-processing, andacquisition of shipping information contained in said digital images andthe entry of said shipping information into an RDBMS maintained on saidnetwork for the purpose of supporting its shipping, tracking, anddelivery operations.

Another object of the present invention is to provide a global Web-basedshipping, tracking, and delivery network, wherein a mobile digital imagecapture and processing instrument is employed aboard eachpickup/delivery vehicle in the network, and which is particularlyadapted for rapid digital imaging and processing of customer shippingdocuments at the point of shipment pickup, as well as the transmissionof electronic data files associated with such digital images to a datacollection and processing center on the network, so as to expedite theprocessing of such digital image files, the extracting shippinginformation therefrom, and the storing of the extracted shippinginformation in a RDBMS on the network, all while the pickup/deliveryvehicle is transporting the shipment from the point of pickup to itsfirst scanning point (e.g. pickup/delivery terminal or sorting androuting hub) in the network, thereby increasing the velocity of shippinginformation across the network, and shortening delivery time through thenetwork to its ultimate destination.

Another object of the present invention is to provide such a globalWeb-based shipping, tracking, and delivery network, which offerscompetitive advantage by increasing customer satisfaction, linkingpaperwork to the tracking number to drastically reduce paperwork beinglost, removing the need to image shipping documents and/or paperwork atits first scanning point in the network, reusing preexistinginfrastructure for automatic processing of shipping document images,recognizing shipping information contained therein, and generating newnetwork-assigned shipping labels at the first scanning point in thenetwork.

Another object of the present invention is to provide such a globalWeb-based shipping, tracking, and delivery network, wherein eachpickup/delivery vehicle is equipped with a mobile digital image captureand processing (MICAP) system that is used to (i) capture and processdigital images of single-sheet shipping documents (i.e. manifests, airbills, bills of lading, etc) at the point of pickup, (ii) automaticallydecode embedded bar codes and perform optical character recognition(OCR) on text presented therein, (iii) format the captured digitalimages with such decoded/recognized shipping information, and (iv)transmit the formatted image files to a data collection and processingcenter in the network, for automatic recognition processing and loadingof the shipping information into the RDBMS maintained by the network.

Another object of the present invention is to provide such a globalWeb-based shipping, tracking, and delivery network, wherein at points ofshipment pickup, digital images of shipping documents are produced andprocessed so as to capture 1D and/or 2D bar-coded shipment trackingnumbers (and optionally, shipping information) graphically representedin the digital images, and then each recognized bar-coded shipmenttracking number (and optionally, machine-recognized shippinginformation) is either stored in the header of the electronic data filesfor the digital images, and is used to name each digital image file,prior to its transmission to a data collection and processing center onthe network.

Another object of the present invention is to provide such a globalWeb-based shipping, tracking, and delivery information network, whereinsuch digital image capture and processing operations are carried outusing a mobile digital image capture and processing (MICAP) system thathas the capacity to store at least 100 high-resolution images of packageshipping documents.

Another object of the present invention is to provide such a globalWeb-based shipping, tracking, and delivery network, wherein the digitalimage capture and processing system comprises a digital image captureand processing instrument that can be mounted within a pickup/deliveryvehicle, or at the counter of a pickup and delivery terminal, forquickly capturing, processing and transmitting digital images ofshipping documents, via electronic data files, to the central datacollection and processing center of the network, over a wirelesscommunications infrastructure.

Another object of the present invention is to provide such a globalWeb-based shipping, tracking, and delivery network, wherein the mobiledigital image capture and processing (MICAP) system comprises a digitalimage capture and processing instrument mounted within a pickup/deliveryvehicle for quickly capturing and processing digital images of shippingdocuments, and transmitting electronic data files of such digital imagesto a hand-held bar-code driven portable/mobile data terminal (PDT) orportable digital assistant (PDA) in wireless communication with theMICAP system, for transmission of the digital image files over awireless communications infrastructure, to a data collection andprocessing center of the network, for subsequent automated imageprocessing, information recognition and information storage within anRDBMS maintained on the network.

Another object of the present invention is to provide such a globalWeb-based shipping, tracking, and delivery network, wherein the mobiledigital image capture and processing (MICAP) system comprises a digitalimage capture and processing instrument which automatically producesdigital images of original shipping documents, at different resolutions.

Another object of the present invention is to provide such a globalWeb-based shipping, tracking, and delivery network, wherein the digitalimage capture and processing instrument employed therein aboardpickup/delivery vehicle, is characterized by a number of innovativefeatures and benefits, including, for example, the following: (i) cangenerate digital images of shipping documents in an image file formattailored for quick transfer to the PDT or PDA in the system; (ii) can beoperated by depressing a single button, thereby minimizing time in thefield; (iii) supports integrated image-processing enhancements; (iv)supports the USB connectivity; (v) supports Bluetooth communicationprotocol for data uploading to the PDA or PDT; (vi) can be triggeredfrom the PDT or PDA in the system; (vii) includes an integratedillumination source that is automatically driven during imagingoperations; (viii) is designed to be powered from a pickup/deliveryvehicle; (ix) has a dust and drip resistant enclosure; and (x) enablesdigital imaging of shipping documents and automatic reading of bar codenumbers (and optically detailed shipping information) graphicallyrepresented in the shipping documents, thereby eliminating lostpaperwork associated with shipment transactions.

Another object of the present invention is to provide such a globalWeb-based shipping, tracking, and delivery network, wherein the digitalimage capture and processing instrument employed therein aboardpickup/delivery vehicle employs an area-type color image sensing arraythat captures and produces digital images of shipping documents, (e.g.manifests, air bills, bills of lading, etc.) that are visually pleasingto view by human operators who are assigned the task of reviewing andanalyzing certain of these images at remote human-operated data-keyingstations on the network, when automated client-side and/or server-sideintelligence recognition processes have not been able to fully orsuccessfully recognize shipping information graphically representedtherein.

Another object of the present invention is to provide such a globalWeb-based shipping, tracking, and delivery network, wherein the digitalimage capture and processing instrument employed therein aboard apickup/delivery vehicle deployed therein is designed to perform itsdocument imaging and processing functions without creating anyadditional steps for the operator, using a rapid, two-button manualoperation.

Another object of the present invention is to provide such a globalWeb-based shipping, tracking, and delivery network, wherein the digitalimage capture and processing instrument employed therein aboardpickup/delivery vehicle can upload digital images of shipping labelswirelessly to a Web-enabled cellular telephone which, in turn, transmitselectronic data files for captured digital images, to one or more remoteapplication servers on the network for automated image processingenabling information recognition and acquisition.

Another object of the present invention is to provide such a globalWeb-based shipping, tracking, and delivery network, wherein the digitalimage capture and processing instrument employed therein aboard apickup/delivery vehicle, can be programmed to upload digital image datato a Web-enabled mobile data terminal, or directly to image processingapplication servers at a data collection and processing center on thenetwork, either after each image scan, or after the completion of agroup of image scans at the point of pickup.

Another object of the present invention is to provide such a globalWeb-based shipping, tracking, and delivery network, wherein the digitalimage capture and processing instrument employed therein aboard apickup/delivery vehicle compresses captured image data so as to reducedata traffic and bandwidth requirements.

Another object of the present invention is to provide a mobile imagecapture and processing (MICAP) system for use in a Web-based shipping,tracking, and delivery network, wherein the MICAP system is unaffectedby temperature extremes, or water, and which offers intelligentoperation and ease of use.

Another object of the present invention is to provide such a mobileimage capture and processing system that can automatically read 1Dand/or 2D bar codes graphically represented in shipping documents duringthe digital imaging thereof, and then automatically encode such bar codenumber/information in a header of a digital image file, and/or use thebar code number/information to name the formatted digital image fileprior to its transmission to a remote image processing center supportedon a package shipping, tracking, and delivery information network.

Another object of the present invention is to provide a mobile imagecapture and processing system that supports a multi-page mode ofoperation for imaging multi-page shipping documents and the like.

Another object of the present invention is to provide such a mobileimage capture and processing system that is capable of storing at leastone hundred digital images of shipping documents, in onboard persistentmemory.

Another object of the present invention is to provide an intelligentimage capture and processing system which includes a digital imagecapture and processing instrument/module that can be mounted in eithermobile or stationary environments, and a Web-enabled mobile datacollection and communication terminal having a touch-screen display,RF-based communication connectivity to the TCP/IP infrastructure of theInternet, and means for remotely triggering the operation of the digitalimage capture and processing instrument/module, uploading digital imagefiles of shipping documents, validating these documents on its displayscreen, and uploading these image files to applications servers on aInternet-based shipping, tracking and delivery information network.

Another object of the present invention is to provide such anintelligent image capture and processing system that supports singlebutton operation, has a USB connectivity option, and supports theBluetooth wireless communication protocol receiving digital image filesof shipping documents, and transmitting such digital images to imageprocessing servers on the network, via IEEE 802.11(g), GSM, GPRS, EDGEand other communication technologies.

Another object of the present invention is to provide such anintelligent image capture and processing system that can be powered fromthe power supply system provided on a conventional automotive vehicle(e.g. van, truck, or tractor-trailer cab).

Another object of the present invention is to provide such a mobileimage capture and processing system which combines the digital imagingof shipping documents, the machine recognition (i.e. reading) of barcode shipment tracking numbers, as well as shipping informationgraphically represented therein, and the automatic encoding of suchinformation into the digital image files generated during the digitalimaging process, so as to facilitate storage, management and access ofsuch shipping documents and shipping information extracted therefrom,stored in the RDBMS of a Web-based shipping, tracking, and deliveryinformation network.

Another object of the present invention is to provide such a mobileimage capture and processing system that can be releasably mountedwithin the cab of a pickup/delivery vehicle, and has the capacity todigitally image at least 30-100 shipping manifests per day.

Another object of the present invention is to provide such a mobileimage capture and processing system which comprises (i) a digital imagecapture and processing instrument for capturing digital images ofshipping documents associated with shipments to be delivered to adestination over a global Web-based shipping, tracking, and deliveryinformation network, and automatically processing such images to read a1D or 2D bar-coded shipment tracking number graphically representedtherein and automatically encode the shipment tracking number withineither the EXIF header of the digital image file and/or the name ortitle of the digital image file, and (ii) a Web-based portable datatransaction terminal (PDT) or a Web-based portable digital assistant(PDA) for receiving digital image files from the digital image captureand processing system (via a wireless data communication link), andtransmitting such digital image files to application processing serverson the network, or to a manual data-keying workstation located at aremote station, where the shipping address, shipment contents and thelike can be manually keyed into an RDBMS by human operators readingdigital images of such digitized shipping documents.

Another object of the present invention is to provide such a mobileimage capture and processing system, wherein the digital image captureand processing instrument has an LED-based illumination array employinga plurality of high-intensity white LEDs and a multi-sided illuminationreflector for focusing narrow-band illumination into the field of view(FOV) of its area-type mega-pixel color image sensing array that iscapable of capturing color images having 2048×1536 pixels, witheight-bit grey-scale representation, and 160 dpi resolution.

Another object of the present invention is to provide such a mobileimage capture and processing system supporting advanced image processingoperations, including: histogram auto-exposure control;color-to-monochrome image sharpening; imaging-based bar code symbolreading; image contrast enhancement; JPEG image compression; and“thumbnail” images creation for digital images captured by the system.

Another object of the present invention is to provide a mobile imagecapture and processing system that leverages the existing infrastructureof conventional Web-based shipping, tracking, and delivery informationnetworks, substantially shortens shipping information capture andbilling time, substantially reduces staffing requirements for manualdata-keying operations on the network, and provides highly reliabledigital image based records of each shipment so as to resolve customerdisputes.

Another object of the present invention is to provide such a mobileimage capture and processing system that is capable of capturing digitalimages of at least 12″×9″ shipping documents.

Another object of the present invention is to provide such a mobileimage capture and processing system for use in connection with aWeb-based shipping, tracking, and delivery information network, whereinthe shipping document associated with any given shipment can be quicklyand simply digitally imaged, processed and formatted to produce imagedata files that include the shipment tracking number (and optionallydetailed shipping information) graphically represented on the originalshipping document, encoded in the file header and the shipment trackingnumber encoded into the name or title of the image file, and transmitted(uploaded) to one or more application servers for image processing andinformation abstraction, and subsequent loading into a RDBMS, withminimal user interaction.

Another object of the present invention is to provide a Web-enabledmobile digital image capture and processing system which comprises: (1)a document imaging and processing instrument adapted for releasablemounting within a pickup/delivery vehicle and having (a) a shippingdocument support platform, upon which a shipping document is placed fordigital imaging, and (b) a digital image capture and processing module,supported above the shipping document support platform by a supportstructure, for capturing and processing high-resolution/high-qualitycolor digital images of the shipping document, automatically recognizingbar-coded shipment tracking numbers (and optionally, detailed shippinginformation) graphically represented in such digital images, andautomatically generating compressed digital image files (i) withmachine-recognized shipment tracking numbers (and optionally, detailedshipping information) encoded in, for example, the EXIF file headers ofthe JPEG-formatted digital image files, and (ii) named or titled usingsuch recognized shipment tracking numbers; and (2) a Web-enabled mobiledata collection and communication terminal, comprising ahand-supportable housing containing an integrated imaging engine orlaser scanning bar code reader, a touch-screen LCD panel fortouch-screen data entry and GUI curser control, a computing platformsupporting an operating system (OS), and client applications, and anRF-based transceiving capabilities (e.g. WiFI 802.11g, 802.11n, andBluetooth) for receiving processed digital image files from the documentimaging and processing instrument (via a first wireless electromagneticcommunication link e.g. Bluetooth), and also for transmitting (via asecond wireless electromagnetic communication link (e.g. Quad-band GSM,GPRS, EDGE, WiFI 802.11g, and 802.11n) such digital image files to imageprocessing application servers maintained on an Internet-based shipping,tracking and delivery network.

Another object of the present invention is to provide a novel Web-basedshipping, tracking, and delivery information network, employing aplurality of mobile image capture and processing systems, wherein eachsuch system is capable of capturing digital images of shippingmanifests, air bills and the like aboard a pickup/delivery vehicle, andtransmitting such shipping document image files to remote imageprocessing application servers on the network for automated shippinginformation abstraction/recover, so that such information processing canbegin at the point of pickup, and during the time it takes for thepickup/delivery vehicle to complete its pickup route and arrive back atthe first scanning point (i.e. pickup and delivery terminal or sortingand routing hub), all shipping information contained in a digitallyimaged shipping label can be automatically captured from and stored intoan RDBMS on the network, and thereby supporting various time-sensitiveservices provided over the network including, for example, early customsclearance processing, early bill processing, wholesale, retail and mailorder distribution, returns processing, as well as scanning of shipmentitems at sorting and routing hubs throughout the network.

Another object of the present invention is to provide a novel method oftranslating a shipping document regarding one or more packages beingshipped, tracked and delivered to a final destination using a Web-basedshipping, tracking, and delivery information network, wherein at thepoint of shipment pickup, the original shipping document in connectionwith a shipment is digitally imaged, the bar-coded shipment trackingnumber (and optionally, detailed shipping information) graphicallyrepresented in the original shipping document is automatically read andits character data string is automatically encoded into the header ofthe corresponding digital image file, and also the shipment trackingnumber is also used to name or title the digital image file, and whilethe package is being delivered to the first scanning point in thenetwork, the digital image file is transmitted (over a wirelesscommunication link) to one or more image processing application serverssupported on the network, and processed so that shipping informationcontained in the digital images (and indexed with the original shipmenttracking number) is automatically abstracted/recognized, and loaded intoan RDBMS maintained on the network; and when the delivered packagephysically arrives at the first scanning point in the network, thebar-coded shipment tracking number (contained in the original shippingdocument) is then read, and corresponding shipping informationmaintained in the RDBMS is accessed, and a unique network-assignedshipping label is automatically generated and then applied to thepackage at the first scanning point in the network, for use inperforming other services supported on the network.

Another object of the present invention is to provide an Internet-basedglobally-extensive shipping, tracking and delivery network of thepresent invention, wherein packages that are picked up at the point ofpick-up, which may or may not bear network-assigned shipping labels, areplaced on the pickup/delivery vehicle and package shipping documents(e.g. manifests, air bills, bills of lading, etc) are digitally imagedand the digital images are transmitted to the data collection andprocessing center of the Network for storage, and recognitionprocessing, and while the shipment is driven to the first scanning pointin the network, the network recognizes/reads all of the shippinginformation in the digital images of the original package shippinglabel, and when the pickup/delivery vehicle arrives at the firstscanning point in the network, the package is sorted and routed usingeither the bar-coded shipment tracking number on the original shippinglabel (as well as information contained in the original shippingdocument imaged at the point of pickup), or a network-assigned shipmenttracking number correlated to the original shipment tracking numberwithin the RDBMS of the network, for roles of facilitating shipmenttracking, early customs clearance, early billing, and package deliveryover the network.

Another object of the present invention is to provide such a novelmethod of translating a shipping document, wherein at the first scanningpoint in the network, the bar-coded shipment tracking number containedin the original shipping document is read using an optical scanningdevice or an imaging-based bar code reading device, so as to accessshipping information stored in the RDBMS corresponding to the package,and sort and route the package to its destination.

Another object of the present invention is to provide such a method ofand apparatus for translating a shipping document, wherein after readingthe original shipment tracking number at the first scanning point in thenetwork and accessing the RDBMS, the method involves generating a uniqueintelligent network-assigned machine-readable (NAMR) shipping labelcomprising a 2D bar-code symbol and/or RFID tag (encoded with a uniquenetwork-assigned shipment tracking number as well as detailed packageshipping information abstracted from the original shipping document),and then applying this intelligent NAMR shipping label to the shipmentitems; and thereafter at subsequent sorting and routing hubs in thenetwork, reading the intelligent NAMR shipping label so as to accessshipping information encoded therein and sort and route the packagethrough the network to its destination.

Another object of the present invention is to provide such a method ofand apparatus for translating a shipping document, wherein after readingthe original shipment tracking number at the first scanning point in thenetwork and accessing the RDBMS, the method involves generating theunique network-assigned shipping label comprising a 1D bar-code symbolor RFID tag (encoded with unique network-assigned shipment trackingnumber, and applying the shipping label to the shipment items); andthereafter at subsequent sorting and routing hubs in the network,reading the shipment tracking number contained in the uniquenetwork-assigned NAMR shipping label, accessing the RDBMS therewith andusing shipping information stored in the RDBMS to sort and route thepackage through the network to its destination indicated in the RDBMS.

Another object of the present invention is to provide such a method ofand apparatus for translating a shipping document, wherein after readingthe original shipment tracking number at the first scanning point in thenetwork and accessing the RDBMS therewith, the method involves usingshipping information stored in the RDBMS so as to sort and route thepackage through the network to its destination indicated in the RDBMS.

The Internet-based shipping, tracking and delivery network and systemcomponents of the present invention offer many benefits and advantagesover conventional networks and systems, namely:

(1) it enables portable (e.g. vehicular) shipping document imaging andprocessing initiated at the point of pickup;

(2) it enables the automatic capture of machine-readable shippingdocument identifiers (e.g. bar-coded shipment tracking numbers);

(3) it enables early customs clearance processing and same-daycorrection by informing the driver while on the road to return to thecustomer for corrections on the same day at the package pickup, so thatthe shipment can clear customs and arrive the next day to itsinternational destination;

(4) it provides ways of handling single-page and multi-page no-reads(i.e. if the bar code is not read within an image, then the image istitled/named with a sequential identifier);

(5) it enables shipment information to arrive immediately in the RDBMSon the network;

(6) it enables faster billing;

(7) it enables optimization of shipment routing over the network; and

(8) it provides improved customer service by allowing customers andrecipients, inquiring about their shipments, to access high-qualitydigital color images of corresponding shipping document over the WorldWide Web (WWW).

These and other objects of the present invention will become apparenthereinafter and in the Claims to Invention appended hereto.

BRIEF DESCRIPTION OF THE DRAWINGS

For a more complete understanding of how to practice the Objects of thePresent Invention, the following Detailed Description of theIllustrative Embodiments can be read in conjunction with theaccompanying Drawings, briefly described below, wherein like referencenumerals are indicate like structures.

FIG. 1 is a schematic representation of a conventional (prior art)Internet-based global-extensive shipping, tracking and delivery network,wherein package, freight and/or cargo shipments that are picked up atthe point of pick-up, which do not bear network-assigned shippingtracking labels (i.e. documents), are placed on the pickup/deliveryvehicle, driven to a first scanning point (i.e. pickup and deliveryterminal or sorting and routing hub) in the network, and then relabeledat a package labeling station through a process requiring the reading oforiginal shipping documents, the generation of new network-assignedshipping tracking labels bearing bar-coded shipment tracking numbers,and the application of these printed labels onto the packages;

FIG. 2A1 is a graphical representation of a GUI screen served toWeb-based client machines by the Web and application servers of theconventional Web-based shipping, tracking and delivery networkillustrated in FIG. 1, in connection with the delivery of variouscategories of services supported on the Internet-based shipping,tracking and delivery network, including, for example, (i) shipping,tracking, managing accounts, and international tools forpackage/envelope services, and (ii) shipping, tracking, managingaccounts, and using international tools for freight services;

FIGS. 2B1, 2B2, 2B3, 2B4, 2B5 and 2B6 provide graphical representationsof six different GUI screens served to web-based client machines by theweb and application servers of the conventional Web-based shipping,tracking and delivery network of FIG. 1, in connection with the deliveryof various kinds of tracking services which can be used bypackage/envelope shippers, military shippers, and cargo shippers overthe network;

FIG. 3 is a flow chart describing the prior art method of picking up,shipping, delivering and tracking shipments using the prior artWeb-based shipping, tracking and delivery network of FIG. 1, whereinshipments which have not been assigned a shipment tracking number by thenetwork (i.e. system) are relabeled at the shipment's first scanningpoint (e.g. pickup and delivery terminal or sorting and routing hub) bya tedious process involving the reading the shipping document at thefirst scanning point, generating a new network-assigned bar-codedshipping tracking label and applying the shipping tracking label ontoeach package in the shipment;

FIG. 4 is a schematic representation of a first illustrative embodimentof the Internet-based globally-extensive shipping, tracking and deliverynetwork of the present invention, wherein shipments that are picked upat the point of pick-up, which may or may not bear network-assignedshipping tracking labels, are placed on the pickup/delivery vehicle andwhile thereon the shipping documents (e.g. shipping manifests, air billsetc) are digitally imaged and the digital image files (encoded with theoriginal shipment tracking number, and optionally, withmachine-recognized shipping information) are transmitted to applicationservers on the network for processing and storage in an RDBMS, and whilethe shipment is transported to a first scanning point in the network,the application servers (and/or human beings at data-keyingworkstations) extract, read or recognize the shipping information in thedigital images of the original shipping document and loads such shippinginformation into the network's RDBMS, and when the pickup/deliveryvehicle arrives at the first scanning point in the network, the shipmentitems are quickly relabeled with an intelligent network-assignedmachine-readable (NAMR) shipping label containing all of the informationin the original shipping label (imaged at the point of pickup) and alsoa network-assigned bar-coded shipment tracking number, for facilitatingshipment tracking, customs clearance, and delivery over the network;

FIGS. 5A through 5C, taken together, set forth a flow chart describingthe steps of a first illustrative embodiment of the shipping documenttranslation process of the present invention involving the digitallyimaging of shipping documents and processing digital images at the pointof pick-up, and remotely processing such digital images while theshipment is being physically transported to the first scanning point inthe network, and generating and applying an intelligent network-assignedmachine-readable shipping label at the first scanning point in thenetwork, as illustrated in FIG. 4;

FIG. 6 is a schematic representation of a second illustrative embodimentof the Internet-based globally-extensive shipping, tracking and deliverynetwork of the present invention, wherein packages that are picked up atthe point of pick-up, which may or may not bear network-assignedshipping labels, are placed on the pickup/delivery vehicle and shippingdocuments are digitally imaged and the digital image files, encoded withthe original shipment tracking number (and optionally withmachine-recognized shipping information) are transmitted to applicationservers for recognition processing and storage in an RDBMS, and whilethe shipment is transported to a first scanning point in the network,the application servers (and/or human beings at data-keyingworkstations) extract, read or recognize the shipping information in thedigital images of the original shipping document, and when thepickup/delivery vehicle arrives at the first scanning point in thenetwork, the shipment items are quickly relabeled with anetwork-assigned machine-readable (NAMR) shipping label containing aunique shipment tracking number associated with information contained inthe original shipping document (imaged at the point of pickup) forfacilitating shipment tracking, customs clearance and delivery over thenetwork;

FIGS. 7A through 7C, taken together, set forth a flow chart describing asecond illustrative embodiment of a shipping document translationprocess according to the present invention, involving the digitallyimaging and transmitting shipping documents (i.e. shipping labels) atthe point of package pick-up, and remotely processing such digitalimages while the shipment is being delivered to the first sorting androuting hub in the network, and generating and applying anetwork-assigned machine-readable (NAMR) shipping label at the firstsorting and routing station in the network illustrated in FIG. 6;

FIG. 8 is a schematic representation of a third illustrative embodimentof the Internet-based globally-extensive shipping, tracking and deliverynetwork of the present invention, wherein packages that are picked up atthe point of pick-up, which may or may not bear network-assignedshipping labels, are placed on the pickup/delivery vehicle and packageshipping labels (e.g. shipping manifests, air bills, bills of lading,etc) are digitally imaged and the digital image files encoded with theoriginal shipment tracking number (and optionally with automaticallyrecognized shipping information) are transmitted to applications serversfor processing and storage in an RDBMS, and while the shipment istransported to a first scanning point in the network, the applicationservers (and/or human-operated data-keying workstations) extract, reador recognize the shipping information in the digital images of theoriginal shipping label, and when the pickup/delivery vehicle arrives atthe first scanning point in the network, the shipment items are sortedand routed using the original bar-coded shipment tracking number on theoriginal shipping document (as well as shipping information contained inthe original shipping document stored in the RDBMS) for facilitatingshipment tracking, customs clearance and delivery over the network;

FIGS. 9A through 9C, taken together, set forth a flow chart describingan illustrative embodiment of the package sorting and routing process ofthe present invention involving the digitally imaging shipping documentsand transmitting digital image files thereof at the point of packagepick-up, and remotely processing such digital image files at applicationservers (and/or human-operated data-keying workstations) while theshipment is being physically transported to a first scanning point inthe network, and then sorting and routing the package by reading theoriginal shipper's shipment tracking number, at the first and subsequentsorting and routing stations in the network, and accessing the RDBMS onthe network, as illustrated in FIG. 8;

FIG. 10A is a schematic representation of a generalized embodiment ofthe Web-based mobile image capture and processing (MICAP) subsystem ofthe present invention, designed for use with the Internet-basedglobally-extensive shipping, tracking and delivery network of thepresent invention, and shown comprising a digital imaging engine, animaging-based bar code reading engine, a form and character stringrecognition engine, a keypad, a display panel (e.g. touch-screen LCDpanel), and RFID tag reader, interfaced with a computing platform havinga microprocessor, a memory architecture, an operating system and one ormore client programs that support (i) e-mail, SMS and IMS services, (ii)the Web-based client-side digital image capture, processing andtransmission functions of the present invention, as well as (iii) theclient-server based image processing and information services supportedon the server-side of the network;

FIG. 10B is a flow chart illustrating the information capture,processing and retrieval operations that the Web-based MICAP system ofFIG. 10A supports over the Internet-based globally-extensive shipping,tracking and delivery network of the present invention;

FIG. 11A is a graphical representation of an exemplary (originalshipper's) package shipping document that can be digitally imaged andprocessed by the Web-based MICAP system of the present invention duringthe course of the process illustrated in FIG. 10B;

FIG. 11B is a graphical representation of a portion of an originalshipper's package shipping document bearing the original shipper'sbar-coded shipment tracking number;

FIG. 11C is a graphical representation of an exemplary GUI displayscreen which is displayed on the Web-enabled MICAP system of the presentinvention, upon the capture of a digital image of a package shippingdocument at a point of pickup in the Web-based shipping, tracking anddelivery network of the present invention;

FIG. 12 shows a perspective view of a first illustrative embodiment ofthe Web-enabled MICAP system of the present invention, shown comprising(1) a document imaging and processing instrument adapted for mountingwithin a pickup/delivery vehicle and a having (a) a shipping documentsupport platform, upon which a shipping document is placed for digitalimaging, and (b) a digital image capture and processing module,supported above the shipping document support platform, for capturingand processing multiple high-quality color digital images of theshipping document, and (2) a Web-based mobile bar code driven datacollection and communication terminal, having the capacity to receivedigital image files of the shipping documents from the digital imagingand processing instrument (via a first wireless electromagneticcommunication link, such as Bluetooth), and also for transmitting suchdigital image files (via a second wireless electromagnetic communicationlink, such as GSM, GPRS, EDGE, IEEE 802.11g, or 802.11n) to applicationservers maintained at a data collection and processing center on theInternet-based shipping, tracking and delivery network of the presentinvention, as shown in FIG. 4, 6 or 8;

FIG. 12A is a perspective view of the digital imaging and processinginstrument of the present invention in FIGS. 12 and 12B, shown arrangedin its “Operational Mode”, wherein its document support tray isconfigured in an unfolded arrangement with respect to the supportstructure for the digital image capture and processing module;

FIG. 12B is a perspective view of the digital imaging and processinginstrument of the present invention in FIGS. 12 and 12A, shown arrangedin its “Storage Mode”, wherein its document support tray is configuredin a folded arrangement with respect to the support structure for thedigital image capture and processing module;

FIG. 13A is a perspective view of the digital imaging and processinginstrument of the present invention, shown in FIGS. 12A and 12B, shownarranged in its Operational Mode with the outer housing removed from thedigital image capture and processing module of the system, revealing itsunderlying electro-optical components;

FIG. 13B is a first perspective view of the digital image capture andprocessing module of the digital image capture and processing instrumentof FIG. 12, shown with its outer housing removed so as to reveal itsunderlying electro-optical components in greater detail;

FIG. 13C is a second perspective view of the digital image capture andprocessing module of the digital image capture and processing instrumentof FIG. 12, shown with its outer housing removed so as to reveal itsunderlying electro-optical components in greater detail;

FIG. 13D is a front perspective view of the digital image capture andprocessing module of the digital image capture and processing instrumentof FIG. 12, shown with its outer housing removed so as to reveal itsunderlying electro-optical components in greater detail;

FIG. 13E is a block schematic diagram of the digital image capture andprocessing instrument of FIG. 12, showing its digital camera board,illumination board, power-supply board, and decode processing andcontrol board interfaced together as shown;

FIG. 13F is a flow chart describing a method of using the Web-basedMICAP system of FIG. 12 in conjunction with the Internet-based shipping,tracking and delivery network of the present invention shown in FIGS. 2,4 and 6;

FIG. 14 is a schematic representation of a process supported in theinstrument of FIG. 12, whereby an unprocessed digital color image iscaptured by the digital image capture and processing instrument shown inFIG. 12, and a graphical representation of an color-B/W converteddigital image produced by the digital image capture and processinginstrument shown in FIG. 12, and a sharpened monochrome image isproduced by the instrument of FIG. 12;

FIG. 15 is a perspective view of an exemplary Web-based mobile bar codedriven data collection and communication terminal, developed andprogrammed in accordance with the principles of the present invention,and adapted for wireless and well as wired communication with thedigital image capture and processing instrument shown in FIG. 12,including running one or more client programs that support (i) e-mail,SMS and IMS services, (ii) digital image file receiving, display,deleting, and transmission functions, and (iii) the client-server basedinformation services supported on the server-side of the network;

FIG. 16 is a perspective view of a second illustrative embodiment of theWeb-enabled MICAP system of the present invention, shown comprising anInternet-enabled mobile image capturing and processing data terminaladapted for capturing digital images shipping documents and processingsuch images at the point of pickup in accordance with the method of thepresent invention, and transmitting corresponding digital image files(via a wireless electromagnetic communication link) to a base stationthat can supported on board a pickup/delivery vehicle, or elsewhereremotely within the network, and then from the base station, the digitalimage files are transmitted (over a second wireless and/orwireless/wired communication links) to application servers maintained ata data collection and processing center, as shown in FIG. 4, 6 or 8;

FIG. 17 is a schematic representation of a second illustrativeembodiment of the Web-based mobile image capture and processing (MICAP)subsystem of FIG. 16, designed for use with the Internet-basedglobally-extensive shipping, tracking and delivery network of thepresent invention, and shown comprising a digital imaging engine, animaging-based bar code reading engine, a form and character stringrecognition engine, a keypad, a touch-screen LCD panel and RFID tagreader, interfaced with a computing platform having a microprocessor, amemory architecture, an operating system and one or more client programsthat support (i) e-mail, SMS and IMS services, (ii) the Web-basedclient-side digital image capture, processing and transmission functionsof the present invention, as well as (iii) the client-server based imageprocessing and information services supported on the server-side of thenetwork;

FIG. 18 is a perspective view of a third illustrative embodiment of theWeb-enabled MICAP system of the present invention, shown comprising aWeb-enabled mobile PC-based cellphone having image capturing andprocessing capabilities for digital imaging shipping documents andprocessing digital images of the shipping documents at the point ofpickup in accordance with the method of the present invention, andtransmitting such digital image files via a wireless electromagneticcommunication link of the TCP/IP based telecommunication networkinfrastructure, to image processing application servers maintained at adata collection and processing center of the network, as shown in FIG.4, 6 or 8;

FIG. 19 is a schematic representation of a third illustrative embodimentof the Web-based mobile image capture and processing (MICAP) subsystemof FIG. 19, designed for use with the Internet-based globally-extensiveshipping, tracking and delivery network of the present invention, andshown comprising a digital imaging engine, an imaging-based bar codereading engine, a form and character string recognition engine, akeypad, a touch-screen LCD panel and RFID tag reader, interfaced with acomputing platform having a microprocessor, a memory architecture, anoperating system and one or more client programs that support (i)e-mail, SMS and IMS services, (ii) the Web-based client-side digitalimage capture, processing and transmission functions of the presentinvention, as well as (iii) the client-server based image processing andinformation services supported on the server-side of the network;

FIG. 20 is a flow chart describing a method of using the Web-based MICAPsystem of FIG. 18 in conjunction with the Internet-based shipping,tracking and delivery network of the present invention, as shown inFIGS. 2, 4 and 6;

FIG. 21A is a schematic representation describing a first illustrativeembodiment of a three-tier Java-Client architecture for the Web, (Java)application, and database (SQL RDBMS) servers maintained at a datacollection and processing center, or elsewhere on the Internet-basedshipping, tracking and delivery network of the present invention, asshown in FIGS. 4, 6 and 8 so as to provide the novel Web-basedinformation services of the present invention to the Web-enabled MICAPsystems of the present invention; and

FIG. 21B is a schematic representation describing a second illustrativeembodiment of a three-tier WebObjects™ HTML-based architecture for theWeb, (Java) application, and database (SQL RDBMS) servers maintained ata data collection and processing center, or elsewhere on theInternet-based shipping, tracking and delivery network of the presentinvention, as shown in FIGS. 4, 6 and 8 so as to provide the novelWeb-based information services of the present invention to theWeb-enabled MICAP systems of the present invention.

DETAILED DESCRIPTION OF THE ILLUSTRATIVE EMBODIMENTS OF THE PRESENTINVENTION

Referring to the figures in the accompanying Drawings, the variousillustrative embodiments of the coaxial-flow heat exchanging (i.e.transferring) structure of the present invention will be described ingreat detail, wherein like elements will be indicated using likereference numerals.

Overview of the Internet-Based Globally-Extensive Shipping Tracking andDelivery Information Network of the Present Invention

In order to compress delivery time and thus improve access in accordancewith the principles of the present invention, a novel global Web-basedshipping, tracking, and delivery information network 10, 10′, and 10″ isprovided as shown in FIGS. 4, 6 and 8, each having numerous shipment“scanning points” (e.g. pickup and delivery terminals 12 and sorting androuting hubs 13 on the network) across the network of the presentinvention.

As shown in FIG. 4, the global Web-based shipping, tracking, anddelivery information network of the present invention comprises a mobiledigital image capture and processing system 20 aboard eachpickup/delivery vehicle or platform 30 deployed in the network. Ingeneral, each mobile digital image capture and processing system isparticularly adapted for rapid digital imaging of customer shippingdocuments 9 (e.g. manifests, air bills, bills of lading, and the like)and processing the digital images 19 at the point of pickup, as well asthe transmission of these digital image files to (i) image processingapplication servers 21 located at one or more data collection andprocessing center(s), or elsewhere on the network, and (ii) one or morehuman-operated data-keying workstations 22, when needed.

In accordance with the spirit of the present invention, the term“pickup/delivery vehicle” as used herein after shall mean vehiclesincluding, but not be limited to: ground-transport vehicles such astrucks, vans, cars, bicycles, pedal-carts, rickshaws and the like;air-transport vehicles such as jets, planes and helicopters;water/sea-transport vehicles such ships, boats and hydro-planes. Also,the term “machine-readable content” as used hereinafter shall meaninformation content including, but not limited to: bar-coded shipmenttracking numbers; and alpha-numerically expressed shipping information,such as the shipper's address, the shipment components and its contents,the number of packages in the shipment, the destination addressincluding street address and postal code, the shipping and deliveryservice requested, customs clearance requirements, and the like.

In the illustrative embodiments of the present invention, the data filesof captured digital images of shipping documents 9 are automaticallyencoded with the original shipment tracking number 17 recognized in theprocessed digital image 11, and the image data file 14 is named ortitled using the same shipment tracking number 17. In such embodimentsof the present invention, role of the image processing applicationservers 24 and human-operated data-keying workstations 22 will be toexpedite the processing of such digital image files 14, the extraction,recognition and/or reading of original shipment tracking numbers, andoptionally shipping information, graphically encoded with the headers ofreceived digital image files (e.g. employing automatic machine-executedform and character recognition processes, as well as human intelligencewhen needed), and ultimately storing the extracted shipping informationinto a shipping information RDBMS 15 on the network, while thepickup/delivery vehicle 30 is transporting the package from the point ofpickup to the first scanning point (i.e. pickup and delivery terminal orsorting and routing hub) on the network.

In other embodiments of the present invention, the electronic data files14 of captured digital images 11 of shipping documents 9 areautomatically encoded with both automatically machine-recognizedoriginal shipment tracking number(s) 17 as well as detailed shippinginformation contained in the original shipping document, while thedigital image files 14 are named or titled using the original shipmenttracking number 17. In such embodiments, the role of the imageprocessing application servers will be to expedite the extraction,recognition and/or reading of shipping information encoded with theheaders of received digital image files, and ultimately storing theextracted shipping information in the shipping information RDBMS on thenetwork, while the pickup/delivery vehicle is transporting the shipmentfrom the point of pickup to the first scanning point (i.e. pickup anddelivery terminal or sorting and routing hub) on the network. If thetransmitted image file does not contain machine-recognized shippinginformation (extracted from the original shipping document at the pointof pickup), due to a failure of a client-side automated form andcharacter recognition engine (i.e. a client-side machine) to recognizesuch shipping information at or after the point of pickup, then the roleof image processing application servers and human-operated data-keyingworkstations will be to expedite the processing of such digital imagefiles, the recognition of shipping information graphically encoded withreceived digital image files (e.g. employing server-side automatic formand character recognition processes, and human intelligence whenneeded), and ultimately storing the extracted shipping information inthe shipping information RDBMS on the network.

By performing these digital image processing and shipment transportoperations in a parallel manner on the global Web-based shipping,tracking, and delivery network of the present invention, the networkefficiently uses the shipment transport time (i.e. measured from thetime of pickup to the time of the first package scan at the firstscanning point) to immediately process digital images of shippingdocuments. It does so by automatically extracting shipping informationgraphically represented in these digital images, and loading thisshipping information into the network's shipping information RDBMS,thereby substantially increasing the velocity of shipping informationacross the network. This increases shipment delivery time, andfacilitates early customs clearance of shipments and billing operations,and provides enhanced packing tracking and other network-supportedservices.

Thus, when the shipment arrives at its first scanning point on thenetwork (e.g. which can take from a few hours up to an entire work day),the network of the present invention can quickly generate and apply anew network-assigned machine-readable (NAMR) shipping label to theshipment, and then sort and route the shipment items through the networkto their ultimate destination, without incurring the typical delaysassociated with conventional approaches to re-labeling of shipments whenthey arrive at their first scanning point in the network. By virtue ofthe present invention, the velocity of shipping information across thenetwork can be greatly increased, shipment delivery time substantiallyshortened, and thereby greatly improving access in accordance with thespirit and principles of the present invention.

Notably, the “parallelized” shipment transport and imagecapture/processing operations supported by the network of the presentinvention provide couriers with several different options for handlingand processing shipments when they arrive at their first scanning point(e.g. pickup and delivery terminal or sorting and routing hub) in thenetwork. In the present invention disclosure herein, three illustrativeembodiments of the network will be described in great technical detail.A brief overview of each network embodiment is in order at thisjuncture.

According to a first illustrative embodiment of the present invention,described in FIGS. 4 through 5C, a unique network-assignedmachine-readable (NAMR) shipping label comprising a 2D bar-code symboland/or RFID tag (encoded with a unique network-assigned shipmenttracking number as well as shipping information abstracted from theoriginal shipping document) is generated after or in response to readingthe original shipment tracking number at the first scanning point in thenetwork and accessing the RDBMS. This intelligent 2D bar-coded label isthen applied to the shipment; and thereafter at subsequent scanningpoints in the network, the intelligent NAMR shipping label 40, 40′ isread so as to access shipping information encoded therein, and sort androute the package through the network to its destination indicated bythe shipping information contained in the intelligent NAMR label.

According to a second illustrative embodiment of the present invention,described in FIGS. 6 through 7C, the unique network-assigned shippinglabel comprising a 1D bar-code symbol and/or RFID tag 50, 50′ encodedwith unique network-assigned shipment tracking number, is generatedafter or in response to reading the original shipment tracking number atthe first scanning point in the network and accessing the RDBMS. ThisNAMR shipping label is then applied to the package; and thereafter atsubsequent sorting and routing hubs in the network, the shipmenttracking number contained in the unique NAMR shipping label is read toaccess the RDBMS, and shipping information stored in the RDBMS is thenused to sort and route the package through the network to itsdestination indicated in the RDBMS.

According to a third illustrative embodiment of the present invention,described in FIGS. 8 through 9C, shipping information stored in theRDBMS is accessed in response to reading the original shipment trackingnumber at the first scanning point in the network. This accessedshipping information is then used to sort and route the shipment throughthe network to its destination indicated in the RDBMS.

Each of these different methods of handling and processing packages at ashipment's first scanning point in the network of the present inventionhave particular benefits and advantages which will become apparenthereinafter.

First Illustrative Embodiment of the Internet-Based Shipping, Trackingand Delivery Network of the Present Invention

In FIG. 4, there is shown the first illustrative embodiment of theInternet-based shipping, tracking and delivery network 10 of the presentinvention. In this embodiment, packages, freight and/or cargo itemswhich are picked up at the point of pick-up, and may or may not bearnetwork-assigned shipping labels, are placed on the pickup/deliveryvehicle 30. Aboard each pickup/delivery vehicle, there is installed amobile image capture and processing (MICAP) system 20 of the presentinvention. In FIGS. 10A and 10B, a generalized embodiment of the MICAPsystem 20 is illustrated. A first illustrative embodiment of the MICAPsystem 20′ is shown in FIGS. 12 through 15; a second illustrativeembodiment of the MICAP system 20″ is shown in FIGS. 16 through 18; anda third illustrative embodiment of the MICAP system 20′″ is shown inFIGS. 19 through 21. Using the MICAP system, shipping documents 9 (e.g.shipping manifests, air bills, bills of lading, etc) are digitallyimaged 11 (preferably but not necessarily within the pickup/deliveryvehicle), and digital image files 14 automatically generated in a formatencoding the original shipment tracking number 17 in the image fileheader, as well as the image file name or title. The image files 14 arethen transmitted (over a wireless communication link) to one or moreimage processing application servers 21 (via web server 14) maintainedat a data collection and processing center of the network. While theshipment is being transported from the point of pick up to its firstscanning point in the network (e.g. pickup and delivery terminal 12 orsorting and routing hub 13), copies of the digital image files may alsobe transmitted from the image processing application servers 21 to oneor more human-operated data-keying workstations 15 operably connected tothe network, that is, if the application server(s) determine thathuman-intelligence is best utilized to recognize the detailed shippinginformation contained any in any particular digital image file. At theimage processing application servers 21 and the human-operateddata-keying workstations 22, shipping information graphicallyrepresented in the digital images of the shipped packages is extracted,recognized and/or read, and then stored in the RDBMS 25 of the network.Notably, in the illustrative embodiment of the present invention,shipping information storage and managements operations within the RDBMSare carried out using the original shipment tracking number graphicallyrepresented in the original shipping document, however and wherever itmay have originated back at the point of pickup.

As illustrated in FIG. 4, when the pickup/delivery vehicle 30 arrives atthe first scanning point in the network, the bar-coded shipment trackingnumber 17 on the unloaded package is scanned using the Web-based MICAPsystem 20 of the present invention, or any Web-enabled PDT, PDA or PCequipped with a laser scanning or an imaging-based bar code reader.Using the read shipment tracking number, the RDBMS is automaticallyaccessed and shipping information relating to the scanned shipment isavailable for presentation and/or display, i.e. if such information isavailable in the RDBMS. Upon the operator's determination that theshipping information has been successful extracted or recognized andstored in the RDBMS (during the transit time between package pickup andarrival at the first scanning point in the network), the shipment isthen ready to be quickly relabeled at the first scanning point.According to the present invention, such package re-labeling operationsinvolve generating an “intelligent” network-assigned machine-readable(NAMR) shipping label embodying (i) the critical information containedin the original shipping document (imaged at the point of pickup) aswell as (ii) a network-assigned shipment tracking number, which iscorrelated to the shipper's shipment tracking number typically appearingon the original shipping document. In accordance with the presentinvention, each intelligent NAMR can be realized as a 2D bar code symbolstructure (including the PDF-417 symbology) and/or data matrix codestructure), and/or an RFID tag 40′ which can be EPC-based so as touniquely identify shipping items from all others in the world. Also, the2D barcode symbol can encode an information field for an EPC, eventhough an RFID tag is not applied to the shipment at this stage of theshipping and delivery process. The intelligent NAMR shipping label,constructed from components 40 and/or 40′, is then produced usingconventional bar code label printing equipment and/or RFID labelingtechniques well known in the art, and then applied to the shipment in aconventional manner, typically at its first scanning point which willtypically be at a pickup and delivery terminal, or a package sorting androuting hub in the network. Thereafter, at subsequent sorting androuting hubs (i.e. scanning points) in the network, the intelligent NAMRshipping label 40 and/or 40′ is read to automatically access encodedshipping information directly from the NAMR label, or alternatively fromthe RDBMS, so as to enable sorting and routing operations. Also, byaccessing the RDBMS using the MICAP system of the present invention, andthen reading the 2D bar-coded label, the courier can acquire shipmentstatus information, and facilitate shipment tracking and packagedelivery over the network.

First Illustrative Embodiment of the Shipping Document Translation andShipment Re-Labeling Process of the Present Invention Carried Out Overthe Internet-Based Shipping, Tracking and Delivery Network of thePresent Invention

In FIGS. 5A through 5C, a method is described for digitally imagingshipping documents (e.g. manifest, air bills, etc.) at the point ofpick-up, and remotely processing such digital images thereof while theshipment is being physically transported to its first scanning point inthe network, at which point therein an intelligent NAMR shipping labelis quickly generated and applied to the scanned shipment, as illustratedin FIG. 4. The steps of this shipping document translation and packagere-labeling process will now be described below.

As indicated at Block A in FIG. 5A, the shipper affixes an originalshipping document (e.g. airway bill or shipping manifest) containingmachine-readable content onto the package to be shipped using the globalpackage shipping, tracking, and delivery network of present invention,shown in FIG. 4.

As indicated at Block B in FIG. 5A, the courier at the point of pick-up,use a MICAP system of the present invention provided aboard thepickup/delivery vehicle to capture preferably multiple (e.g. three)digital images of the original shipping document associated with theshipment. Preferably, each digital image will have a different imageresolution for serving different user and system requirements throughoutthe network of the present invention. For example, in the illustrativeembodiment, the multiple digital images of a shipping package documentwill include: (1) a low-resolution “thumbnail-size” color digital imageof the shipping document for display on the touch-screen of the MICAPsystem, and other client machines throughout the network; (2) anintermediate-resolution color digital for helping the courier to quicklyvalidate or invalidate a captured image of a shipping document atpackage pickup; (3) a high-resolution color digital image of theshipping document which can be scrutinized by the courier at the pointof package-pickup, as well as human data-keying operators on thenetwork, who can zoom in on image features and the like as required bythe application at hand; and (4) high-resolution sharpened monochromatic(BW) digital image of the shipping document (i.e. converted from thehigh-resolution color digital image thereof) for use by client-side andserver-side machine-implemented symbol, form and character recognitionprocesses performed in accordance with the spirit of the presentinvention.

As indicated at Block C in FIG. 5A, the MICAP system is used by thecourier/operator to automatically process the captured images of theoriginal shipping document 9 (e.g. shipping manifest or label) andrecognize the machine-readable content (e.g. shipper's bar-codedshipment tracking number 17, and optionally, the shipping information)graphically represented in the captured digital image.

As indicated at Block D in FIG. 5A, the MICAP system automaticallyformats the processed image(s) of the original shipping label 9 byencoding the read bar-coded shipper's shipment tracking number 17 (andoptionally, machine-recognized shipping information) as a “tag” in theheader field of each image file 14 generated, as well as encodingshipment tracking number (e.g. 12345) as the name or title of the imagefile; and if tagging is not used or permitted in a given application,then encode both the image and machine-readable information (e.g.shipper's tracking number 17 and optionally the shipping information) asseparate data files, each having the same unique file name, but alsohaving different file extensions (e.g. 12345.jpg and 12345.txt).

As indicated at Block E in FIG. 5A, the courier then loads the shipmentinto a shipping container or onto a pickup/delivery vehicle 30 destinedfor a first scanning point in the network. Notably, depending on theparticular embodiment of the MICAP system used in any particularapplication, this shipment loading step may also occur before the stepindicated in Block B above, so that imaging of the shipping label occursinside the pickup/delivery vehicle using, for example, the MICAP systemas shown in FIGS. 12A through 15, wherein the digital image capture andprocessing instrument is mounted within the cab of the pickup/deliveryvehicle.

As indicated at Block F in FIG. 5B, the MICAP System is then used toupload the formatted image files over the wireless communication link(s)and infrastructure of the network, to the image processing applicationservers 21 at data collection and processing center 18, as shown in FIG.4.

As indicated at Block H1 in FIG. 5B, at the image processing applicationserver(s), (i) the received image files of the original shippingdocument are immediately processed, (ii) encoded tags (e.g. bar-codedshipper's shipment tracking number, and possibly machine-recognizedshipping information) are automatically extracted, (iii) optionally, theformat of images is converted if needed, (iv) a network (e.g. FEDEX)shipment tracking number is assigned to the shipment, and (v) theretrieved and processed images are stored in the RDBMS of the datacollection and processing center using both the original shipper'sshipment tracking number and the shipment tracking number as arelational indices in the RDBMS.

As indicated at Block H2 in FIG. 5B, if indicated by the processingresults at Block at Block H1 (i.e. image quality is poor and/or there isinsufficient shipping information encoded within the tags, byclient-side machine-recognition efforts), then copies of the receivedand processed shipping document image files are forwarded (i.e.transmitted) over the network information infrastructure to the networkapplication servers (i.e. server-side automated form and characterrecognition systems) 21 and/or the human data-keying workstations 22for: (1) processing and analyzing the shipping document image files inorder to recognize and extract (i.e. abstract) therefrom informationrelating to the shipment associated with the corresponding shippinglabel (e.g. the identity of the shipper, shipper's address, the shipmentcomponents and contents, number of packages, destination addressincluding street address and postal code, and/or service, customsclearance requirements, and the like); and (2) storing in the RDBMS 15,such recognized and extracted components of shipment-related informationfor subsequent access and use by various service-related applicationssupported by the network.

In the illustrative embodiment, automated form and character recognitionprocesses will be supported on both the client-side of the network by anautomated form and character recognition engine (within system 20), andon the server-side of the network by network application servers 21.Such processes will employ a combination of advanced software-based formrecognition (FR), optical character recognition (OCR) and intelligentcharacter recognition (ICR) techniques, as disclosed in U.S. Pat. No.6,961,456 incorporated herein by reference. In the illustrativeembodiments, these techniques are performed on the high-resolutionmonochromatic digital images generated by the MICAP systems of thepresent invention, in either a real-time or batch mode manner, usingpowerful computing platforms and resources on client and/or server sidesof the network, as the case may be. Preferably, such OCR and ICRtechniques will be form-directed, in that, when a particular shippingdocument form or format has been automatically recognized, the systemwill apply software-based OCR and/or ICR techniques to captured digitalimages so as to the recognize the alphanumerical characters which arecontained in particular sections of the recognized form. Ideally, suchOCR and ICR techniques will be based on the science of neural networksthat behave like the human brain when processing information. BecauseICR techniques can handle variations in character shape, the term‘intelligent’ is combined with ‘character recognition’ to describehandprint recognition. Such automated form and character recognitiontechniques are generally known to those with ordinary skill in the art.

As indicated at Block G in FIG. 5B, image processing operationsindicated at Blocks H1 and H2 are performed, in parallel (i.e. while)the shipped package(s) are transported from the point of pickup to thefirst scanning point (e.g. pickup and delivery terminal or sorting androuting hub) in the network.

As indicated at Block I in FIG. 5C, when the shipping container orpickup/delivery vehicle arrives at its first scanning point in thenetwork, the following operations are performed:

(1) unload the packages from the shipping container or pickup/deliveryvehicle and transport the shipment to the sorting and routing facility(i.e. first scanning point);

(2) read the machine-readable code (i.e. shipper's shipment trackingnumber) on the original shipping label affixed to the shipment;

(3) generate an intelligent network-assigned machine-readable (NAMR)shipment tracking label 40, 40′ as described hereinabove, that isencoded with (i) the network-assigned shipment tracking number that hasbeen assigned by the network (e.g. FEDEX) to the original shipper'spackage tracking number, (ii) digital images of the original shippinglabel, as well as (iii) all other items of package shipping informationencoded in the original shipping label on the package;

(4) apply the intelligent NAMR shipment tracking label to the shipmentitems; and

(5) read the intelligent NAMR shipment tracking label (typically usinghigh-velocity tunnel-type bar code symbol and/or RFID reading systems,through which shipment items pass on a moving conveyor belt system), andaccess encoded sorting and routing instructions from the intelligentNAMR shipment tracking label, and use these instructions toautomatically sort and route the package at the first sorting androuting hub of the network.

As indicated at Block K in FIG. 5C, at each subsequent scanning point inthe network, the relabeled shipment items are sorted and routed to theirdestination points by the following operations:

(i) reading the intelligent NAMR shipment tracking label applied to theshipment,

(ii) extracting from the read intelligent NAMR shipment tracking label,sorting and routing instructions (originally encoded in the originalshipper's shipping label), and

(iii) following such sorting and routing instructions so as to deliverthe shipment to its destination point, wherever that may be along thesupply chain.

As indicated at Block L in FIG. 5C, at the destination point, thecourier (i.e. delivery person or courier) uses the MICAP system 20 toread the intelligent NAMR shipment tracking label on the shipment, andinform the RDBMS that the shipment has been successfully delivered toits destination point.

Using any Web-enabled client device with a graphical user interface(GUI), the customer, shipper or other authorized parties can, at anytimeduring the package delivery process (i.e. from the point of pickup, tothe point of delivery at the destination), (i) log into the Web-serverof the Web-based shipping, tracking and delivery network, (i) trackpackage, envelope and/or freight shipments using the “original” shipmenttracking number on the shipper's original shipping manifest/label, aswell as any network-assigned shipment tracking number (generated usingthe shipping document translation process of the present invention), aswell as other alternative references described in the Background ofInvention; and (ii) receive immediate notifications about clearancedelays, attempted deliveries, proofs of delivery, etc via email,Internet and/or wireless communication methods.

Notably, this embodiment of the present invention can be readilymodified such that it is mandated that the electronic data files ofcaptured digital images of shipping documents are automatically encodedwith both machine-recognized original shipment tracking number(s) aswell as shipping information contained in the original shippingmanifest, while the electronic file is automatically named or titledusing the shipment tracking number. In such an alternative embodiment ofthe network of FIGS. 4 through 5C, the role of the image processingapplication servers 21 will be to expedite the server-side extraction ofshipping tracking number(s) and shipping information encoded within theheaders of received digital image files, and ultimately storing theextracted shipping information in the shipping information RDBMS 15 onthe network, while the pickup/delivery vehicle is transporting thepackage from its point of pickup to its first scanning point in thenetwork. However, if the transmitted image file does not containmachine-recognized shipping information (i.e. extracted from theoriginal shipping manifest during client-side machine-recognitionoperations), due to a failure to recognize by the client-side automatedform and character recognition engine at the point of pickup, then therole of image processing application servers 21 and human-operateddata-keying workstations 22 will be to expedite: (i) the processing ofsuch digital images, (ii) the recognition of shipping informationgraphically encoded with received digital image files (e.g. employingautomatic form and character recognition processes, and humanintelligence when needed), and ultimately (iii) the storing of theextracted shipping tracking number(s) and shipping information in theRDBMS 15 on the network.

Second Illustrative Embodiment of the Internet-Based Shipping, Trackingand Delivery Network of the Present Invention

In FIG. 6, there is shown the second illustrative embodiment of theInternet-based shipping, tracking and delivery network 10′ of thepresent invention. In this embodiment, shipments which are picked up atthe point of pick-up, and may or may not bear network-assigned shippinglabels, are placed on the pickup/delivery vehicle. Aboard eachpickup/delivery vehicle, there is installed a mobile image capture andprocessing (MICAP) system 20 of the present invention. In FIGS. 10A and10B, a generalized embodiment of the MICAP system 20 is illustrated. Afirst illustrative embodiment of the MICAP system 20′ is shown in FIGS.12 through 15, a second illustrative embodiment of the MICAP system 20″is shown in FIGS. 16 through 18, and a third illustrative embodiment ofthe MICAP system 20′″ is shown in FIGS. 19 through 21. Using the MICAPsystem, shipping documents are digitally imaged (preferably within thevehicle), and digital image files automatically generated in a formatencoding the original shipment tracking number in the image file headerand/or the image file name, and then transmitted (over a wirelesscommunication link) to one or more image processing application servers21 maintained at the data collection and processing center of thenetwork. While the shipment is being driven from the point of pick up tothe first scanning point in the network (e.g. pickup and deliveryterminal or sorting and routing hub), copies of the image files are alsotransmitted from the image processing application servers, to one ormore human-operated data-keying workstations 22 operably connected tothe network. At the image processing application servers 21 and thehuman-operated data-keying workstations 22, shipping informationgraphically represented in the digital images of the shipments isabstracted/recognized, and then stored in the RDBMS 15 of the network.In the illustrative embodiment, shipping information storage andmanagements operation within the RDBMS are carried out using theoriginal shipment tracking number graphically represented in theoriginal shipping document, however and wherever it may have originatedback at the point of pickup. As illustrated in FIG. 6, when thepickup/delivery vehicle 30 arrives at the first scanning point (e.g.pickup and deliver terminal or sorting and routing hub) in the network,the bar-coded shipment tracking number on the unloaded package isscanned (e.g. using the Web-based MICAP system of the present invention,or any Web-enabled PDT, PD or PC equipped with a laser scanning or animaging-based bar code reader). Using the read shipment tracking number,the RDBMS is automatically accessed and shipping information relating tothe scanned package is available for presentation and/or display. Uponoperator's determination that the shipping information has beensuccessful abstracted and stored in the RDBMS (i.e., during the transittime between package pickup and arrival at the first scanning point inthe network), the shipment is then ready to be quickly relabeled at thefirst scanning point by generating a network-assigned machine-readable(NAMR) shipping label embodying a network-assigned shipment trackingnumber, which is correlated to the shipper's original shipment trackingnumber typically appearing on the original shipping document. Inaccordance with the present invention, each intelligent NAMR can berealized as a 1D bar code symbol structure 50, and/or an RFID tag 50′which can be EPC-based so as to uniquely identify shipping items fromall others in the world. Also, the 1D bar code symbol can encode aninformation field for an EPC, even though an RFID tag is not applied tothe shipment at this stage in the shipping and deliver process. This newtranslated NAMR shipping label, constructed from components 50 and/or50, and embodying the network-assigned bar-coded shipment trackingnumber, is produced using conventional bar code symbol and/or RFID labelproducing equipment, and applied to the shipment in a conventionalmanner well known in the art. Thereafter at subsequent scanning pointsin the network, the NAMR shipping label (encoded with thenetwork-assigned shipment tracking number) can be used read to accessencoded shipping information from the RDBMS 15, so as to enable sortingand routing operations, as well as facilitating shipment tracking, earlycustoms clearance and billing, and shipment delivery over the network.

Second Illustrative Embodiment of the Shipment Manifest Translation andShipment Re-Labeling Process of the Present Invention Carried Out Overthe Internet-Based Shipping, Tracking and Delivery Network of thePresent Invention

In FIGS. 7A through 7C, a method is described for digitally imagingshipping documents (e.g. shipping labels, air bills) at the point ofshipment pick-up, and remotely processing such digital images thereofwhile the shipment is being physically transported to its first sortingand routing hub in the network, at which point therein an 1D bar-codedshipping label 50 is quickly generated and applied to the scannedpackage at its first scanning point in the network, as illustrated inFIG. 6. The steps of this shipping document translation and packagere-labeling process will now be described below.

As indicated at Block A in FIG. 7A, the shipper affixes an originalshipping label (e.g. airway bill or shipping manifest document)containing machine-readable content (e.g. shipper's bar-coded shipmenttracking number 17, and shipping information) onto the package to beshipped using the global package shipping, tracking, and deliverynetwork of present invention, as shown in FIG. 6.

As indicated at Block B in FIG. 7A, the courier at the point of shipmentpick-up, use a MICAP system 30 provided aboard the pickup/deliveryvehicle (or shipping container) to capture preferably multiple (e.g.three) digital images of the original shipping document.

As indicated at Block C in FIG. 7A, the MICAP system is used by theoperator to process the captured images of the original shippingdocument 9 and read the machine-readable content (e.g. shipper'sbar-coded shipment tracking number 17, and optionally detailed shippinginformation) graphically represented in the captured image 11.

As indicated at Block D in FIG. 7A, within the MICAP system,automatically formats the processed image(s) of the original shippingdocument by encoding the read bar-coded shipper's shipment trackingnumber (and optionally, machine-recognized shipping information) as a“tag” in the header field of each image document 14 generated, as wellas assigning the shipment tracking number 17 as the name or title ofimage file 14; and if tagging is not used or permitted in a givenapplication, then encode both the image and machine-readable info (e.g.shipper's tracking number 12345) as separate data files, each having thesame unique file name, but also having different file extensions (e.g.12345.jpg and 12345.txt).

As indicated at Block E in FIG. 7A, the courier then loads the shipmentinto a shipping container or onto a pickup/delivery vehicle destined toa first scanning point in the network. Notably, depending on theparticular embodiment of the MICAP system used in any particularapplication, this shipment loading step may also occur before the stepindicated in Block B above, so that imaging of the shipping documentoccurs inside the pickup/delivery vehicle using, for example, the MICAPsystem as shown in FIGS. 12A through 15, wherein the digital imagecapture and processing instrument is mounted within the cab of thepickup/delivery vehicle.

As indicated at Block F in FIG. 7B, the MICAP system is then used toupload the formatted image files over the wireless communication link(s)and infrastructure of the network, to its image processing applicationservers 21 at the data collection and processing center or elsewhere inthe network, as shown in FIG. 6.

As indicated at Block H1 in FIG. 7B, at the image processing applicationserver(s), (i) the received image files of the original shippingdocument are immediately processed, (ii) encoded tags (e.g. bar-codedshipper's shipment tracking number, and possibly, machine-recognizedshipping information) are automatically extracted, (iii) optionally, theformat of images is converted if needed, (iv) a network-assigned (e.g.FEDEX) shipment tracking number is assigned to the shipment, and (v)extracted shipping information and images are stored in the RDBMS on thenetwork using both the original shipper's shipment tracking number aswell as the network-assigned shipment tracking number as a relationalindices in the RDBMS.

As shown at Block H2 in FIG. 7B, if indicated by the processing resultsat Block at Block H1 (i.e. image quality is poor and/or there isinsufficient shipping information encoded within the tags, byclient-side machine-recognition efforts), then copies of the receivedand processed shipping document image files are forwarded (i.e.transmitted) over the network information infrastructure to the networkapplication servers (i.e. server-side automated form and characterrecognition systems) 21 and/or the human-operated data-keyingworkstation 22 for: (1) processing and analyzing the shipping documentimage files in order to extract and/or recognize therefrom, originalshipment tracking numbers and shipping information relating to theshipment associated with the digital image files; and (2) storing in theRDBMS 15, such recognized and extracted shipping information forsubsequent access and use by various service-related applicationssupported by the network.

In the illustrative embodiment, automated form and character recognitionprocesses will be supported on both the client-side of the network byautomated form and character recognition engine (in system 20), and onthe server-side of the network by network application servers 21. Suchprocesses will employ a combination of advanced software-based formrecognition (FR), optical character recognition (OCR) and intelligentcharacter recognition (ICR) techniques, as disclosed in U.S. Pat. No.6,961,456 incorporated herein by reference. In the illustrativeembodiments, these techniques are performed on the high-resolutionmonochromatic digital images generated by the MICAP systems of thepresent invention, in either a real-time or batch mode manner, usingpowerful computing platforms and resources on client and/or server sidesof the network, as the case may be. Preferably, such OCR and ICRtechniques will be form-directed, in that, when a particular shippingdocument form or format has been automatically recognized, the systemwill apply software-based OCR and/or ICR techniques to captured digitalimages so as to the recognize the alphanumerical characters which arecontained in particular sections of the recognized form. Ideally, suchOCR and ICR techniques will be based on the science of neural networksthat behave like the human brain when processing information. BecauseICR techniques can handle variations in character shape, the term‘intelligent’ is combined with ‘character recognition’ to describehandprint recognition. Such automated form and character recognitiontechniques are generally known to those with ordinary skill in the art.

As indicated at Block G in FIG. 7B, image processing operationsindicated at Blocks H1 and H2 are performed, in parallel (i.e. while)the shipped package(s) are transported from its point of pickup to itsfirst scanning point in the network.

As indicated at Block I in FIG. 7C, when the shipping container orpickup/delivery vehicle arrives at its first scanning point in thenetwork, the following operations are performed:

(1) unload the shipment items from the shipping container orpickup/delivery vehicle and transport the shipment to its first scanningpoint in the network;

(2) read the machine-readable code (i.e. shipper's shipment trackingnumber 17) on the original shipping label 9 affixed to the shipment;

(3) generate a network-assigned machine-readable (NAMR) shipmenttracking label 50 and/or 50′ as described above (which is encoded withthe network shipment tracking number assigned by the network to thecorresponding original shipper's shipment tracking number);

(4) apply the generated NAMR shipment tracking label 50 and/or 50′ tothe package; and

(5) read the NAMR shipment tracking label 50 and/or 50′ (i.e. typicallyusing high-velocity tunnel-type bar code symbol and/or RFID tag readingsystems, through which shipment items pass on a moving conveyor beltsystem), to access sorting and routing instructions in the RDBMS, anduse these accessed instructions to automatically sort and route theshipment at its first sorting and routing hub of the network.

As indicated at Block J in FIG. 7C, at each subsequent scanning point inthe network, the relabeled shipment is sorted and routed to itsdestination point by the following operations:

(i) reading the NAMR shipment tracking label 50 and/or 50′ applied tothe shipment,

(ii) accessing (in real-time over the network) sorting and routinginstructions from the RDBMS 15, and

(iii) following such sorting and routing instructions so as to deliverthe shipment to its destination point wherever that may be along theglobal supply chain.

As indicated at Block L in FIG. 7C, at the destination point, thecourier (i.e. delivery person) uses the MICAP system to read the NAMRshipment tracking label on the package, and inform the RDBMS on thenetwork that the shipment has been successfully delivered to itsdestination point.

Using any Web-enabled client device with a graphical user interface(GUI), the customer, shipper or other authorized parties, at anytimeduring the package delivery process (i.e. from the point of pickup, tothe point of package delivery at the destination, and thereafter), can:

(i) log into the Web-server of the Web-based shipping, tracking anddelivery network, (i) track package, envelope, ground and/or freightshipments using (1) the “original” shipment tracking number on theshipper's original shipping document, (2) any network-assigned shipmenttracking number (generated using the shipping document/label translationprocess of the present invention), as well as (3) other alternativereferences described in the Background of Invention; and

(ii) receive immediate notifications about clearance delays, attempteddeliveries, proofs of delivery, etc via email, Internet and/or wirelesscommunication methods.

Notably, this embodiment of the present invention can be readilymodified such that it is mandated that the electronic data files ofcaptured digital images of shipping documents are automatically encodedwith both machine-recognized original shipment tracking number(s) aswell as shipping information contained in the original shippingmanifest, while the electronic file is automatically named or titledusing the shipment tracking number. In such an alternative embodiment ofthe network of FIGS. 6 through 7C, the role of the image processingapplication servers 21 will be to expedite the server-side extraction ofshipping tracking number(s) and shipping information encoded within theheaders of received digital image files, and ultimately storing theextracted shipping information in the shipping information RDBMS 15 onthe network, while the pickup/delivery vehicle is transporting thepackage from its point of pickup to its first scanning point in thenetwork. However, if the transmitted image file does not containmachine-recognized shipping information (i.e. extracted from theoriginal shipping manifest during client-side machine-recognitionoperations), due to a failure to recognize by the client-side automatedform and character recognition engine at the point of pickup, then therole of image processing application servers 21 and human-operateddata-keying workstations 22 will be to expedite: (i) the processing ofsuch digital images, (ii) the recognition of shipping informationgraphically encoded with received digital image files (e.g. employingautomatic form and character recognition processes, and humanintelligence when needed), and ultimately (iii) the storing of theextracted shipping tracking number(s) and shipping information in theRDBMS 15 on the network.

Third Illustrative Embodiment of The Internet-Based Globally-ExtensiveShipping, Tracking And Delivery Network Of The Present Invention

In FIG. 8, there is shown the third illustrative embodiment of theInternet-based shipping, tracking and delivery network 10″ of thepresent invention. In this embodiment, packages which are picked up atthe point of pick-up, and may or may not bear network-assigned shippinglabels, are placed on the pickup/delivery vehicle. Aboard eachpickup/delivery vehicle, there is installed a mobile image capture andprocessing (MICAP) system of the present invention. In FIGS. 10A and10B, a generalized embodiment of the MICAP system is illustrated. Afirst illustrative embodiment of the MICAP system is shown in FIGS. 12through 15; a second illustrative embodiment of the MICAP system isshown in FIGS. 16 through 18; and a third illustrative embodiment of theMICAP system is shown in FIGS. 19 through 21. Using the MICAP system,shipping documents are digitally imaged (preferably within the vehicle),digital image files automatically generated in a format encoding theoriginal shipment tracking number in the image file header (andoptionally, machine-recognized shipping information), the digital imagefile named or titled using the original shipping tracking number, andthen the formatted image files are transmitted (over a wirelesscommunication link) to one or more image processing application servers21 maintained on the network. While the shipment is being transportedfrom its point of pick up to its first scanning point in the network,copies of the image files are also transmitted from the image processingapplication servers, to one or more human-operated data-keyingworkstations 22, if the application servers determine that the digitalimages are of poor quality, machine-recognition is not reliable underdetected conditions, or for other rational conditions. At the imageprocessing application servers 21 and the human-operated data-keyingworkstations 22, shipping information graphically represented in thedigital images of the shipped packages is extract and/or recognized, andthen stored in the RDBMS 15 of the network. In the illustrativeembodiment, shipping information storage and managements operationwithin the RDBMS are carried out using the original shipment trackingnumber graphically represented in the original shipping document,however and wherever it may have originated back at the point of pickup.

As illustrated in FIG. 8, when the pickup/delivery vehicle 30 arrives atits first scanning point in the network, the original bar-coded shipmenttracking number 17 (or other shipment identifier) on the unloadedpackage is scanned (e.g. using the Web-based MICAP system of the presentinvention, or any Web-enabled PDT, PD or PC equipped with a laserscanning or an imaging-based bar code reader). Using the read originalshipment tracking number, the RDBMS is automatically accessed andshipping information relating to the scanned package is determined asbeing available or unavailable for presentation and/or display. Uponcourier's determination that the package's shipping information has beensuccessful recognized, extracted and stored in the RDBMS, the package isthen ready to be quickly scanned, sorted and routed at its firstscanning point (e.g. pickup and delivery terminal or sorting and routinghub) in the network. At subsequent scanning points in the network, theoriginal bar-coded shipment tracking number can be read to accessencoded shipping information, so as to enable sorting and routingoperations, as well as facilitating shipment tracking, customsclearance, and package delivery over the network.

Third Illustrative Embodiment of the Shipping Document TranslationProcess of the Present Invention Carried Out Over the Internet-BasedShipping, Tracking and Delivery Network of the Present Invention

In FIGS. 9A through 9C, a method is described for digitally imagingshipping documents (e.g. shipping labels, air bills) at the point ofshipment pick-up, and processing such digital images thereof while theshipment is being physically transported to its first scanning point inthe network, as illustrated in FIG. 8. The steps of this process willnow be described below.

As indicated at Block A in FIG. 9A, the shipper affixes an originalshipping document (e.g. airway bill or shipping manifest) containingmachine-readable content (e.g. shipper's bar-coded shipment trackingnumber and detailed shipping information) onto the package to be shippedusing the global package shipping, tracking, and delivery network ofpresent invention, shown in FIG. 8.

As indicated at Block B in FIG. 9A, at the point of package pick-up, thecourier uses a MICAP system provided aboard the pickup/delivery vehicle(or shipping container) to capture a multiple digital images of theoriginal shipping document 9 relating to the shipped package.

As indicated at Block C in FIG. 9A, the MICAP system is used by theoperator process the captured images of the original shipping document,and recognized its machine-readable content (e.g. shipper's bar-codedshipment tracking number 17, and optionally, detailed shippinginformation) graphically represented in the captured image.

As indicated at Block D in FIG. 9A, the MICAP system automaticallyformats the processed image files of the original shipping document byencoding the machine-recognized bar-coded original shipment trackingnumber 17 (and optionally, machine-recognized shipping information) as a“tag” in the header field of each image document 14 generated, and alsonames or titles the image file using the original shipment trackingnumber; and if tagging is not used or permitted in a given application,then encode both the image and machine-readable info (e.g. shipper'stracking number 12345, and optionally, the detailed shippinginformation) as separate data files, each having the same unique filename, but also having different file extensions (e.g. 12345.jpg and12345.txt).

As indicated at Block E in FIG. 9A, the courier then loads package intoshipping container or onto a package/delivery vehicle destined for itsfirst scanning point in the network. Notably, depending on theparticular embodiment of the MICAP system used in any particularapplication, this package loading step may also occur before the stepindicated in Block B above, so that imaging of the package documentoccurs inside the pickup/delivery vehicle using, for example, the MICAPsystem as shown in FIGS. 12A through 15, wherein the digital imagecapture and processing instrument is mounted within the cab of thepickup/delivery vehicle.

As indicated at Block F in FIG. 9B, the MICAP system is then used toupload the formatted image files 14 over the wireless communicationlink(s) and infrastructure of the network, to image processingapplication servers at a data collection and processing center on thenetwork, as shown in FIG. 6.

As indicated at Block H1 in FIG. 9B, at the image processing applicationserver(s), (i) the received image files of the original shippingdocument are immediately processed, (ii) encoded tags (e.g. bar-codedshipper's shipment tracking number, and possibly detailed shippinginformation) are automatically extracted, (iii) optionally, the formatof images is converted if needed, (iv) a network (e.g. FEDEX) shipmenttracking number is assigned to the shipment, and (v) the extractedand/or recognized shipment tracking number, image data and shippinginformation are stored in the RDBMS using both the original shipper'sshipment tracking number and the network-assigned shipment trackingnumber as a relational indices in the RDBMS.

As shown in Block H2 in FIG. 9B, if indicated by the processing resultsat Block at Block H1 (i.e. image quality is poor and/or there isinsufficient shipping information encoded within the tags, byclient-side machine-recognition efforts), then copies of the receivedand processed shipping document image files are forwarded to networkapplication servers (i.e. server-side automated form and characterrecognition systems) 21 and/or the human-operated data-keyingworkstation 22 for: (1) processing and analyzing the shipping documentimage files in order to extract and/or recognize therefrom, shippingtracking number(s) and shipping information relating to the shipmentassociated with the corresponding image file; and (2) storing in theRDBMS, such extracted and/or recognized components of shipment-relatedinformation for subsequent access and use by various service-relatedapplications supported by the network.

In the illustrative embodiment, automated form and character recognitionprocesses will be supported on both the client-side of the network byautomated form and character recognition engine within system 20, and onthe server-side of the network by network application servers 21. Suchprocesses will employ a combination of advanced software-based formrecognition (FR), optical character recognition (OCR) and intelligentcharacter recognition (ICR) techniques, as disclosed in U.S. Pat. No.6,961,456 incorporated herein by reference. In the illustrativeembodiments, these techniques are performed on the high-resolutionmonochromatic digital images generated by the MICAP systems of thepresent invention, in either a real-time or batch mode manner, usingpowerful computing platforms and resources on client and/or server sidesof the network, as the case may be. Preferably, such OCR and ICRtechniques will be form-directed, in that, when a particular shippingdocument form or format has been automatically recognized, the systemwill apply software-based OCR and/or ICR techniques to captured digitalimages so as to the recognize the alphanumerical characters which arecontained in particular sections of the recognized form. Ideally, suchOCR and ICR techniques will be based on the science of neural networksthat behave like the human brain when processing information. BecauseICR techniques can handle variations in character shape, the term‘intelligent’ is combined with ‘character recognition’ to describehandprint recognition. Such automated form and character recognitiontechniques are generally known to those with ordinary skill in the art.

As indicated at Block G in FIG. 9B, image processing operationsindicated at Blocks H1 and H2 are performed, in parallel (i.e. while)the shipped package(s) are transported from the point of pickup to itsfirst scanning point (i.e. pickup and delivery terminal or sorting androuting hub) in the network.

As indicated at Block I in FIG. 9C, when the shipping container orpickup/delivery vehicle arrives at its first scanning point in thenetwork, the following operations are performed:

(1) unload the shipments from the shipping container or pickup/deliveryvehicle and transport the shipments to its first scanning point in thenetwork;

(2) read the machine-readable information (i.e. shipper's shipmenttracking number 17, and optionally, the detailed shipping information)contained in the original shipping document 9 associated with theshipment;

(3) provide produced symbol and character data from scanning process tothe RDBMS 15, so as to determine and confirm that the original sortingand routing information has been acquired from the digital images of theoriginal shipping document on the shipment (at the point of pickup), andstored in the RDBMS of the network; and

(4) if so, then read the original bar-coded shipment tracking number 17(e.g. typically using high-velocity tunnel-type bar code readingsystems, through which shipments pass on a moving conveyor belt system),and access sorting and routing instructions from the RDBMS, and usethese instructions to sort and route the shipment at its first sortingand routing hub in the network.

As indicated at Block K in FIG. 9C, at each subsequent scanning point inthe network, the relabeled package is sorted and routed to itsdestination point by the following operations:

(i) reading the original bar-coded shipment tracking number 17 appliedto the shipment,

(ii) accessing (in real-time over the network) sorting and routinginstructions from the RDBMS; and

(iii) following such sorting and routing instructions so as to deliverthe shipment to its destination point, wherever that may be along thesupply chain.

As indicated at Block L in FIG. 7C, at the destination point, thecourier (i.e. delivery person) can use the MICAP system to read theoriginal bar-coded shipment tracking label on the shipment, and informthe RDBMS of the network that the shipment has been successfullydelivered to its destination point.

Using any Web-enabled client device with a graphical user interface(GUI), the customer, shipper or other authorized parties, at anytimeduring the delivery process (i.e. from the point of pickup, to the pointof shipment delivery at the destination) can:

(i) log into the Web-server of the Web-based shipping, tracking anddelivery network;

(ii) track package, envelope and/or freight shipments using the“original” shipment tracking number on the shipper's original shippingdocument, as well as any network-assigned shipment tracking number(generated using the shipping document translation process of thepresent invention), or other alternative references described in theBackground of Invention; and

(iii) receive immediate notifications about clearance delays, attempteddeliveries, proofs of delivery, etc via email, Internet and/or wirelesscommunication methods.

Notably, this embodiment of the present invention can be readilymodified such that it is mandated that the electronic data files ofcaptured digital images of shipping documents are automatically encodedwith both machine-recognized original shipment tracking number(s) aswell as shipping information contained in the original shippingmanifest, while the electronic file is automatically named or titledusing the shipment tracking number. In such an alternative embodiment ofthe network of FIGS. 8 through 9C, the role of the image processingapplication servers 21 will be to expedite the server-side extraction ofshipping tracking number(s) and shipping information encoded within theheaders of received digital image files, and ultimately storing theextracted shipping information in the shipping information RDBMS on thenetwork, while the pickup/delivery vehicle is transporting the packagefrom its point of pickup to its first scanning point in the network.However, if the transmitted image file does not containmachine-recognized shipping information (i.e. extracted from theoriginal shipping manifest during client-side machine-recognitionoperations), due to a failure to recognize by the client-side automatedform and character recognition engine at the point of pickup, then therole of image processing application servers and human-operateddata-keying workstations will be to expedite: (i) the processing of suchdigital images, (ii) the recognition of shipping information graphicallyencoded with received digital image files (e.g. employing automatic formand character recognition processes, and human intelligence whenneeded), and ultimately (iii) the storing of the extracted shippingtracking number(s) and shipping information in the RDBMS on the network.

Generalized Embodiment of the Web-Based Mobile Image Capture andProcessing (MICAP) Subsystem of the Present Invention

In FIG. 10A, there is shown a generalized embodiment of the Web-basedmobile image capture and processing (MICAP) subsystem of the presentinvention, designed for use with the Internet-based globally-extensiveshipping, tracking and delivery network of the present invention. Asshown the MICAP system 20 comprises: an integrated digital imagingengine 51 for digital image capture; an imaging-based bar code readingengine 52 for recognizing 1D and/or 2D bar-coded labels in capturedimages; a form and character string recognition engine 53 forrecognizing forms and alpha-numeric character strings within capturedimages; a touch-screen LCD panel 54 with LCD controller 55A for enablingtouch-screen data entry and application cursor control; LCD brightnesscontrol circuit 55B: a microprocessor 56; program memory (DRAM) 57:non-volatile memory (SDRAM, flash memory, hard-disc etc) 58; a datatransmission circuit 59; an RF transceiver circuit 60; an RF antenna 61;power supply 62; trigger switch 63 for generating a trigger signal; arechargeable battery and a recharging circuit 64; system buses, a memorybridge 65; an I/O chipset; a visual display device; an audio displaydevice; an RFID tag reading engine 67; a manual data input device, andthe like. The microprocessor and memory architecture of the MICAP systemprovides a computing platform supporting an operating system (OS), suchas Linux, OSX or Windows, and one or more application programs,including a Web browser program, and a client application program (e.g.Java client program). The function of such client application programsis to support (i) e-mail, SMS and IMS services over the network, (ii)the client-side digital image capture and processing, and digital imagefile transmission functions of the present invention, as well as (iii)the client-server based image processing and information servicessupported on the server-side of the network, using communicationservices such as Quad-band GSM, GPRS, EDGE, WiFI 802.11g, 802.11n,and/or Bluetooth, as the case may be. In general, the MICAP system andits functionalities can be realized in many different forms, includingthe illustrative embodiments shown in FIGS. 12 through 21.

Digital images captured by the MICAP system of the present invention canbe used for the following applications: shipping document image scan andcapture; shipping document optical character recognition (OCR) and ICR;telecoding (i.e. manual image data capture from displayed image); andother applications.

In FIG. 10B, there is presented a flow chart that describes the basicinformation capture, processing and retrieval operations that aresupported on Web-based MICAP system of FIG. 10A, in connection with theInternet-based shipping, tracking and delivery network of the presentinvention shown in FIGS. 4, 6 and 8.

As indicated at Block A in FIG. 10B, upon generation of a trigger signalfrom the MICAP System, the MICAP system automatically captures, atdifferent resolutions, multiple digital images of package shippingdocument (e.g. shipping manifest) as shown in FIG. 11A, and then buffersthese digital images in its onboard memory storage.

As indicated at Block B in FIG. 10A, the MICAP system automaticallyprocesses the buffered digital images so as to read the machine-readableinformation (e.g. shipper's shipment tracking number, and optionally,detailed shipping information) graphically represented in the digitalimage of the original shipping document, as shown in FIG. 11B, andproduce symbol and character data representative thereof.

As indicated at Block C in FIG. 10B, the MICAP system automaticallyencodes, as a tag, the symbol and character data (i.e. shipper'sshipment tracking number and possibly shipping information) into theEXIF header of the file format (e.g. .pdf, .tiff, or other taggable fileformat) that is used to encode the captured digital images fortransmission, storage and subsequent use on the network of the presentinvention. Also, the MICAP system uses the recognized original shippingtracking number to name or title the digital image file.

As indicated at Block D in FIG. 10B, the MICAP system is used totransmit the bar-coded-tagged digital images to the network applicationservers 21 maintained at a data collection and processing center, orelsewhere in the network, whereupon, such digital image files arestorage in the RDBMS of the network, and subsequent processed inaccordance with the principles of the present invention.

As indicated at Block E in FIG. 10B, at any time, the courier (whotypically drives a pickup/delivery vehicle 30 in FIG. 4, 6, or 8) canuse the Web-enabled MICAP system (running its Web-enabled clientapplication or Web browser program) to review the captured digitalimages of the original shipping document that are stored in the RDBMSand awaiting server-side machine and/or human recognition processing, asshown in FIG. 11C.

As indicated at Block F in FIG. 10B, the courier can use the Web-enabledMICAP system (with its Web-enabled client application or Web browserprogram running) to review the shipping status information served upfrom the RDBMS. Such viewing can be initiated by reading a bar-codedshipment tracking number using the bar code reader integrated into theMICAP system, or by entering shipping information into the RDBMS of thenetwork, via the touch-screen GUI of the MICAP system.

Alternatively, this embodiment of the present invention of the presentinvention can be readily modified such that the Web-enabled MICAP systemautomatically generates electronic data files of captured digital imagesof shipping documents, which are encoded with both automaticallyrecognized original shipment tracking number(s) as well as shippinginformation contained in the original shipping manifest, while theelectronic file is named or titled using the shipment tracking number.In such an alternative embodiment of the Web-enabled MICAP System, therole of the image processing application servers on the network will beto expedite the extraction of shipping information encoded with theheaders of received digital image files, and ultimately storing theextracted shipping information in the shipping information RDBMS on thenetwork, all while the pickup/delivery vehicle is being transporting thepackage from the point of pickup to the first scanning point (i.e.pickup and delivery terminal or sorting and routing hub) in the network.However, if the transmitted image file does not contain recognizedshipping information (extracted from the original shipping manifest),due to a failure to recognize by the client-side automated form andcharacter recognition engine 53 at the point of pickup, then the role ofimage processing application servers 21 and human-operated data-keyingworkstations 22 will be to expedite the processing of such digitalimages, the recognition of shipping information graphically encoded withreceived digital image files (e.g. employing automatic form andcharacter recognition processes, and human intelligence when needed),and ultimately storing the extracted shipping information in theshipping information RDBMS on the network.

First Illustrative Embodiment of the Web-Based Mobile Image Capture andProcessing (MICAP) Subsystem of the Present Invention

As shown in FIG. 12, a first illustrative embodiment of the Web-enabledMICAP system of the present invention 20′ generally illustrated in FIGS.10A and 10B, shown comprising: (1) a document imaging and processinginstrument 70 adapted for releasable mounting within a pickup/deliveryvehicle and having (a) a shipping document support platform 71, uponwhich a shipping document 9 (e.g. shipping label, air bill, etc) isplaced for digital imaging, and (b) a digital image capture andprocessing module 72, supported above the shipping document supportplatform by a support structure 73, for capturing and processinghigh-resolution/high-quality color digital images 11 of the shippingdocument 9, automatically recognizing bar-coded shipment trackingnumbers 17 in such digital images, and automatically generatingcompressed digital image files 14 (i) with machine-recognized shipmenttracking numbers 17 (and optionally, detailed shipping informationencoded within, for example, the EXIF file headers of the JPEG digitalimage files, and/or (ii) named or titled using such recognized shipmenttracking numbers; and (2) a Web-enabled mobile data collection andcommunication terminal 75, comprising a hand-supportable housingcontaining an integrated imaging engine or laser scanning bar codereader 76, a touch-screen LCD panel 77 for touch-screen data entry andGUI curser control, function keys 78, trigger switch 79, an RFID tagreader 101, a computing platform 80 supporting an operating system (OS),and client applications, and an RF-based transceiving capabilities (e.g.Quad-band GSM, GPRS, EDGE, WiFI 802.11g or 802.11n, and/or Bluetoothcommunication protocols) for receiving shipping document image filesfrom the document imaging and processing instrument (via a firstwireless electromagnetic communication link e.g. Bluetooth), and alsofor transmitting (via a second wireless electromagnetic communicationlink, e.g. Quad-band GSM, WiFI 802.11g, EDGE) these digital image filesto the network image processing application servers 21 maintained on thenetwork of the present invention, as shown in FIG. 4, 6 or 8. Morespecifically, the Web-enabled mobile data collection and communicationterminal 75 uploads the shipping document image files 14 to the networkimage application processing servers 21. For those digital images whichhave not been recognized by neither client-side nor server-sideautomated form and recognition machines, copies of the high-resolutioncolor image files are transmitted to a human-operated data-keyingworkstation 22, for human-assisted shipping informationreading/recognition, and data entry into the RDBMS 15. So, if there is aproblem with a customs form entry, the network application servers havean opportunity to detect such problems, while the package is beingtransported to its first scanning point (e.g. shipping and deliveryterminal or scanning and routing hub), and provide the customer a chanceto resolve the problem, or have the driver return to the customer to getthe necessary corrections, without losing the next-day shipmentcapability over the network. The use of this wireless MICAP systemincludes applications such as, for example: digital image capture ofshipping manifests and air bills; in-truck scanning; early customsdocument processing; early bills processing; wholesale, retail and mailorder distribution; returns processing; as well as manual presentationscanning.

As shown in FIG. 12A, the digital imaging and processing instrument 70is arranged in its Operational Mode with its document support tray 71configured in an unfolded arrangement with respect to the supportstructure 73 for the digital image capture and processing module 72. Asshown, a pair of hinges provide a means for coupling the documentsupport tray to the support structure 73, although other mechanism mightbe used in alternative embodiments of the present invention. In FIG.12B, the digital imaging and processing instrument 70 is shown arrangedin its Storage Mode with its document support tray configured in afolded arrangement with respect to the support structure for the digitalimage capture and processing module. As shown, the digital image captureand processing module 72 has a plurality of buttons 82 through 83 which,when depressed, active particular modes of operation of the instrumentwhich will be described in detail below.

As shown best in FIG. 12A, the support structure 73 of the instrumenthas a pair of mounting holes 73A and 73B, for mounting the instrument toa structure within the pickup/delivery vehicle, or within the interiorof an airplane, helicopter, boat, ship, or other transportation vehicle.The digital image capture and processing instrument may also findapplication within the interior or exterior of a building, or otherstructure or location where there is a need for rapidly and simplycapturing and processing digital images of shipping documents and thelike, and generating and transmitting (to local or remote servers)digital images being named and/or having encoded therein the originalshipment tracking numbers associated with their corresponding originalshipping manifests.

In FIGS. 13A through 13D, the digital image capture and processingmodule 72, including it primary electro-optical components, are clearlydisclosed in great detail by removing its outer housing or casing 84. Inthe illustrative embodiment, the digital image capture and processingmodule 84 comprises: a housing having a light transmission aperture 85with an optically transparent imaging window 86 mounted thereover; anoptical bench/support base 87 mounted to the open side of the housing,and supporting the optical, electro-optical and mechanical parts of themodule; a digital camera board 88 mounted (via bar-coded) to the opticalbench/support base 87, and supporting a high-resolution/high-velocityarea-type color image sensing/detecting array (e.g 2048×1536-pixel area)89, sensing array control electronics, and image capture and bufferingelectronics; an imaging lens assembly 90 mounted to the camera board 88and having a field of view (FOV) on the area-type image sensing array89; a LED-based illumination board 91 supporting a pair of white-type(broad-band) LEDs 92A and 92B and about which an horn-type lightfocusing reflector 93 is operably mounted for focusing the illuminationfrom the LEDS into and over the FOV of the image sensing array; a powersupply and LED driver/control board 94 for supplying electrical power tocomponents within the module (e.g. from a 12 Volt automotive orAC-operated power transformer), and for driving the LEDs in response tocontrol signals; a digital image-processing and system control board 95supporting a microprocessor 96, DRAM 97, EPROM 98, VRAM, Flash imagememory 99, and other non-volatile memory, a memory bridge, clocks, powerreference termination, display controller, I/O chips, RF-based datatransceiver chips 100, etc., an operating system (OS) and running clientapplication programs to support the image capture, processing, display,transmission and other functionalities of the module (including captureand bar code reading engines 51, 52 and form and character recognitionengine 53), USB and Ethernet data communication ports, wireless I/Ointerfaces and the like; and a plurality of push or touch type modeselection buttons 10A through 101D which, upon depression, generatecontrol signals that are sent to the digital image-processing and systemcontrol board. The function of such client application programs is tosupport (i) e-mail, SMS and IMS services, (ii) the client-side digitalimage capture, processing and transmission functions of the presentinvention, as well as (iii) the client-server based image processing andinformation services supported on the server-side of the network.

Notably, the MICAP system of the first illustrative embodiment is easilyoperated using two simple buttons (i.e. a Round Button and a SquareButton). Depressing the Round Button 82 automatically causes the MICAPsystem to perform the following client-side information capture andprocessing operations:

(i) generates multiple (e.g. four) digital images of the shippingdocument (as described hereinabove);

(ii) forwards the high-resolution monochromatic (BW) image data frame tothe image-processing based bar code (1D and 2D) symbol reading enginefor automated reading/recognition of bar-coded shipping tracking numbersor other bar-coded identifiers graphically represented in the digitalimage;

(iii) optionally, forwards the high-resolution monochromatic (BW) imagedata frame to the automated form and character recognition engine forautomatically recognizing shipping information graphically representedwith the particular format of the digitally-imaged shipping document atthe point of pickup;

(iv) automatically encodes, as tags, within the header of the digitalimage files of the digital images, (1) the bar-coded shipping trackingnumber and/or other bar-coded shipment or shipper identifiers recognizedby the image-processing based bar code symbol reading engine, and (2)optionally, machine-recognized shipping information generated by theautomated form and character recognition engine; and

(iv) automatically names or titles the digital image files using themachine-recognized shipment tracking number.

Notably, the Round Button will be used when the courier desires todigitally image the shipping document, read any 1D and/or 2D bar-codedsymbols (e.g. shipment tracking numbers) graphically representedtherein, and generate digital image files having names or titles encodedthe content of the recognized bar-coded symbols (e.g. 12345).

In contrast with the Round Button described above, the Square Buttoncauses generates digital image files for the shipping document, and doesnot attempt to read or recognize any bar code symbols oralpha-numerically expressed information graphically represented in thecaptured digital images. Shipping document images generated by pressingthe Square Button will be named, titled or indexed based on thebar-coded symbol(s) read in the previously captured digital image inresponse to depressing the Round Button.

This two-button operation of the MICAP system of this illustrativeembodiment of the present invention is very useful because it allowsimaging of correlated multi-page shipping documents. During operation,the MICAP system can digitally image 9″×12″ shipping documents with 160dpi resolution, consistently reading bar codes with 10-mil linesgraphically encoded within the document. Upon reading the bar code inthe captured image, the system automatically titles (i.e. names) thescanned image with the automatically recognized bar-codedshipment/package tracking number graphically represented in the capturedigital image, providing easy data indexing referencing within the RDBMSof the network, in which the MICAP system has been designed to operate.The depth-of-focus (DOF) of the digital image capture and processingmodule accommodates the imaging of single flat documents, a documentatop of stack of documents, a document on a clipboard, as well as curleddocuments (and any combination of the above).

In the illustrative embodiment, the digital image capture and processinginstrument of the MICAP system supports all major bar code formats andsymbologies, and has at least 16 MB RAM for storing at least 100 pagesof scanned images, using JPEG compression.

In a preferred embodiment, a high-volume color image sensing array 89 isused in the digital image capture and processing module, similar tothose used in digital cameras, as this makes it easier to achieve thelow production cost. However, image-processing based bar code reading,as well as automated form and character recognition processing, is bestperformed on sharpened monochrome (BW) images. Thus, the digital imagecapture and processing instrument of first illustrative embodiment ofthe present invention employs a multi-stage color/BW image conversionmethod illustrated in FIGS. 14A through 14C. According to thismulti-stage color/BW image conversion method, each unprocessed colordigital image shown in FIG. 14A, produced by color image sensing array,is first converted into a black and while (BW) or monochrome digitalimage shown in FIG. 14B using a color-to-monochrome blurring function;and then the monochrome digital image is converted into a sharpmonochrome (BW) digital image using an edge sharpening function. Thisimage conversion process is supported by the image processingcapabilities of the digital image-processing and system control board95, shown in FIG. 13E.

As mentioned above, the digital image capture and processing module 72of the illustrative embodiment is programmed to generated multiple (e.gfour) digital images of each captured shipping document, and eachdigital image has a different image output resolution for meeting therequirements of different purposes and applications on the network,namely: (1) a low-resolution “thumbnail-size” color digital image of theshipping document for display on the touch-screen of the MICAP system,and other client machines throughout the network; (2) anintermediate-resolution color digital for helping the courier to quicklyvalidate or invalidate a captured image of a shipping document atpackage pickup; (3) a high-resolution color digital image of theshipping document for scrutiny by the courier at the point ofpackage-pickup, as well as by human data-keying operators on thenetwork, who can zoom in on image features and the like as required bythe application at hand; and (4) high-resolution sharpened monochromatic(BW) digital image of the shipping document (i.e. converted from thehigh-resolution color digital image thereof) for use by client-side andserver-side machine-implemented symbol, form and character recognitionprocesses performed in accordance with the spirit of the presentinvention.

As shown in FIGS. 12A and 12B, the plurality of LED indicators on thetop of the housing visually indicate the various scanning modes of thesystem, its operation, and memory-full warnings. In the illustrativeembodiment, two scan modes are implemented, namely: (i) a single-pagedocument scan mode for imaging a single page document; and (ii) amulti-page document scan mode, for imaging documents larger than thetray, which require multiple page scans.

As shown in FIG. 12A, the 9″×12″ document support tray 71 accommodatesstandard 8.5″×11″ paper. As shown in FIG. 12B, this tray folds up whennot being used, and folds down to a slightly (10˜15 degree) tiltedposition for scanning/imaging documents. When then the MICAP system isconfigured in its operational mode, as shown in FIG. 12A, the imagingwindow of the digital image capture and processing module 72 is mountedparallel to the document support tray for uniform image-based scanning.The slight tilt to the document support tray makes it easier fordocuments to be quickly “thrown” into the tray, and helps the papershipping document stay in place during image-based scanning operationswhich are initiated with the single push of button 82. As shown in FIG.12A, a lip is provided around the tray perimeter so as to help maintainpaper documents in place during imaging operations. In the illustrativeembodiment, the tray hinges are detented, with detents in the 0-degree(folded up) position for storage, 90-degree (horizontal) position forscanning, and 180-degree (folded down and away from the camera)positions for storage. This feature provides a “break-away” feature fordriver safety. During a collision, any force imparted to the tray willresult in the tray falling down and away from the driver to preventinjury.

During the single-page document scan mode, which is required to image ashipping document consisting of a single page, the following operationsare performed by the courier (i.e. driver): (1) place the single pageshipping document in the document support tray, as shown in FIG. 12A;and press the Round Button on the housing. Automatically, the shippingdocument is digitally imaged, and three color digital images aregenerated at three different resolutions (i.e. low, medium, and high).The high-resolution color image is processed to achieve the color/BWconversion, and generating the high-resolution color image. Thehigh-resolution BW image is processed by the imaging-based bar codereading engine 52 to read any bar-coded shipment/package trackingnumbers and/or other identifiers in the digital image. Thereafter, allof the digital image files are named or titled using read shipmenttracking number (i.e. the PRO number), and then buffered in flash memoryof the system, for subsequent retrieval. Audio and visual notificationvalidates correct image capture. The stored image files can be uploadedin the background to the Web-enabled mobile data collection andcommunication terminal 75, as described hereinabove.

During the multi-page document scan mode, which is often required toimage documents larger than the document support tray, the followingoperations are performed: (1) place shipping manifest page bearing thebar-coded shipment tracking number, within the document support tray;(2) press the Round Button 82 on the housing; (3) then place second pageof the shipping document in the document support tray; (4) press SquareButton 83 on the housing; (5) repeat steps 3 and 4 as needed to imageand format all pages of the multi-page shipping document. Automatically,the system reads the bar code(s) shipment tracking number on the firstpage of the document, and names the image file therewith (i.e. the PROnumber) then buffered in flash memory of the system. All pages imagedusing the Square Button 83 will be indexed to the first imaged page ofthe multi-page shipping document. This method also works for oversizedpaperwork. Audio and visual notification validates correct capture.Digital image files are stored for later retrieval, and can be uploadedin the background to the Web-enabled mobile data collection andcommunication terminal.

Method of Using the Web-Based MICAP System of First IllustrativeEmbodiment in Conjunction with the Internet-Based Shipping, Tracking andDelivery Network of the Present Invention

FIG. 13F describes a method of using the Web-based MICAP system of FIG.12 in conjunction with the Internet-based shipping, tracking anddelivery network of the present invention shown in FIGS. 2, 4 and 6.

As indicated at Block A in FIG. 13F, upon generation of a trigger signalfrom the MICAP System, multiple digital images of package label arecaptured at different image resolutions, and then buffered in the memorystorage of the MICAP System.

As indicated at Block B in FIG. 13F, the MICAP system automaticallyprocesses the buffered digital images so as to read or recognizemachine-readable information (e.g. shipper's shipment tracking number,and optionally, machine-recognized shipping information) graphicallyrepresented in the digital image of the original shipping document, andproduce symbol and character data representative thereof.

As indicated at Block C in FIG. 13F, the MICAP system automaticallyencodes, as a tag, the symbol and character data (i.e. shipper'sshipment tracking number, and possibly the shipping information) intothe EXIF header of the file format (e.g. .pdf, .tiff, or other taggablefile format) used to format captured digital images. In addition to theabove tagging operation, the recognized shipment tracking numberstherein are used to title or name the produced image files. For example,if only one bar-coded number is recognized in the captured image, andits content was the number string “12345”, then the resulting imagewould be named “12345.jpg”. At the same time, the bar-coded content“12345” would also be stored in the EXIF header of the jpg-formattedimage file. In accordance with the present invention, all processes andservices supported in the network are driven from this recognitionbar-coded content, and therefore, all images of shipping manifestscaptured, processed and stored on the network will be “referenced”directly through the 12345 number string, and related to other data inthe RDBMS describing the shipment.

At this stage of the process, the courier may use the Web-enabled mobiledata collection and communication terminal of the MICAP system toinspect the captured image files and verify that he or she wants toretain them or discard them from memory. This validation step allows forre-capture of the shipping document images should the image quality ofthe first round of images not be sufficiently good. In connection withimage validation, the multiple (e.g. four) captured images of differentresolution are automatically transmitted from the digital image captureand processing module 72 to the Web-enabled mobile data collection andcommunication terminal 75, in order to assist the courier (i.e. driver)in validating captured images on the display screen of his or her mobiledata collection and communication terminal 75. Specifically, firsttransmitted image is the color low-resolution thumbnail image which isdisplays on the display screen GUI of the mobile terminal. Transmissionof this first reduced size image helps to overcome the current velocitylimitations of the Bluetooth communication link between the instrument72 and the terminal 85, and quickly provides a “snapshot” for thecourier. At the same time, in the background, the medium-resolutioncolor image is transmitted wirelessly from the instrument to the mobileterminal, and allows for a full screen view on the display screen of themobile terminal. This second higher resolution image would be used formore detailed inspection of the captured image where the operator canzooms in to view its details. Finally, at the same time, a full-sizehigh-resolution image is transmitted from the instrument to the mobileterminal, and this digital image is only intended for downstreamoperators, such as image processing application servers andhuman-operated data-keying workstations deployed on the network of thepresent invention.

As indicated at Block D in FIG. 13F, the bar-coded tagged digital imagesare transmitted from the MICAP system to the remote image processingapplication servers (e.g. via http), for processing and storage in theRDBMS of the network.

As indicated at Block E in FIG. 13F, at any time, the Web-enabled MICAPSystem can be used view the digital image of the shipping label storedin the RDBMS, and awaiting processing.

As indicated at Block F in FIG. 13F, the Web-enabled MICAP System can beused to view the shipping status information in the RDBMS, by readingbar codes or entering shipment related information in the RDBMS of theNetwork.

Alternatively, this embodiment of the present invention of the presentinvention can be readily modified so that the Web-enabled MICAP systemautomatically generates electronic data files of captured digital imagesof shipping documents, which are encoded with both automaticallyrecognized original shipment tracking number(s) as well as shippinginformation contained in the original shipping manifest, while theelectronic file is named or titled using the shipment tracking number.In such an alternative embodiment of the Web-enabled MICAP System, therole of the image processing application servers 21 on the network willbe to expedite the extraction of shipping information encoded with theheaders of received digital image files, and ultimately storing theextracted shipping information in the shipping RDBMS 15 on the network,all while the pickup/delivery vehicle is being transporting the packagefrom the point of pickup to the first scanning point (i.e. pickup anddelivery terminal or sorting and routing hub) in the network. However,if the transmitted image file does not contain recognized shippinginformation (extracted from the original shipping manifest), due to afailure to recognize by the client-side automated form and characterrecognition engine 53 at the point of pickup, then the role of imageprocessing application servers 21 and human-operated data-keyingworkstations 22 will be to expedite the processing of such digitalimages, the recognition of shipping information graphically encoded withreceived digital image files (e.g. employing automatic form andcharacter recognition processes, and human intelligence when needed),and ultimately storing the extracted shipping information in theshipping information RDBMS on the network.

Second Illustrative Embodiment of the Web-Based Mobile Image Capture andProcessing (MICAP) Subsystem of the Present Invention

FIG. 16 shows a second illustrative embodiment of the Web-enabled MICAPsystem of the present invention. As shown, the Web-enabled MICAP system20″ comprises: a mobile image capturing and processing wireless/mobiledata terminal 110 adapted for the digital imaging and processing ofshipping documents at the point of pickup in accordance with the methodof the present invention, and transmitting such digital images (via awireless electromagnetic communication link) to a base station 111(supported on board the pickup/delivery vehicle or elsewhere remotelywithin the network), and then from the base station 111 to imageprocessing application servers 21 maintained on the network (via asecond wireless electromagnetic communication link), as shown in FIG. 4,6 or 8. The Web-enabled MICAP system 20″ embodies the same or similarimage capture and processing capabilities as the system disclosed inFIGS. 12A through 15C, except that the digital image capture andprocessing instrument portion of the system is embodied within a mobilehand-supportable housing, and provided with RF-based data packetcommunication capabilities with its base station 111. In vehicularapplication involving pickup/delivery vehicles, the base station 111 canbe mounted within the cab of the vehicle so that it will be in closeproximity with its corresponding mobile image capturing and processingwireless/mobile data terminal 110 whose range will be determined by thefirst RF communication link of the MICAP system, between the mobile dataterminal 110 and the base station 111.

As shown in FIG. 17, the mobile Web-based image capturing and processingwireless/mobile terminal 111 comprises in a hand-supportable housing: anintegrated digital imaging engine 51 for digital image capture; animaging-based bar code reading engine 52 for recognizing 1D and/or 2Dbar-coded labels in captured images; a form and character stringrecognition engine 53 for recognizing forms and alpha-numeric characterstrings within captured images; a touch-screen LCD panel 54 with LCDcontroller 55A for enabling touch-screen data entry and applicationcursor control; LCD brightness control circuit 55B; a microprocessor 56;program memory (DRAM) 57; non-volatile memory (SDRAM, hard-disc etc) 58;an RF transceiver circuit 59; and an RF antenna coupled to the RFtransceiver circuit supporting WiFI 802.11g, EDGE and/or Bluetoothcommunication protocols; power supply 62; trigger switch 63 forgenerating a trigger signal; a rechargeable battery; system buses, amemory bridge, an I/O chipset, a visual display device, an audio displaydevice, an RFID reading engine and antenna 67, a manual data inputdevice, and the like. The microprocessor and memory architecture of themobile terminal 110 provides a wireless computing platform supporting anoperating system (OS), such as Linux, OSX or Windows, and one or moreapplication programs, including a Web browser program, and a clientapplication program (e.g. Java client program). The function of suchclient application programs is to support (i) e-mail, SMS and IMSservices, (ii) the client-side digital image capture, processing andtransmission functions of the present invention, as well as (iii) theclient-server based image processing and information services supportedon the server-side of the network.

As shown in FIG. 17, the base station 111 comprises: a first RFtransceiver circuit 120 coupled to a first RF antenna for receivingelectromagnetic signals (over a first RF band) from the antenna withinthe mobile terminal 110 and supporting WiFI 802.11g, 802.11n and/orBluetooth communication protocols; a second RF signal transceivercircuit 121 coupled to the first RF transceiver circuit 120, and havinga second RF antenna 121 and supporting Quad-band GSM, GPRS, EDGE, WiFI802.11g or 802.11n communication protocols; a power control anddistribution circuit: and a base station controller 123 operably coupledto the first and second RF transceiver circuits 120 and 121, and abattery recharging circuit 24.

During operation on the network of the present invention, the Web-basedMICAP system 20″ is used to capture and processhigh-resolution/high-quality color digital images of virtually anyshipping document, automatically recognize bar-coded shipment trackingnumbers (as well as detailed shipping information) graphicallyrepresented in such digital images, and automatically generatecompressed digital image files (i) with machine-recognized shipmenttracking numbers (and optionally, detailed shipping information) encodedwithin, for example, the EXIF file headers of the JPEG digital imagefiles, and/or (ii) named or titled using such recognized shipmenttracking numbers.

Method of Using the Web-Based MICAP System of Second IllustrativeEmbodiment in Conjunction with the Internet-Based Shipping, Tracking andDelivery Network of the Present Invention

Next will be described a method of using the Web-based MICAP system ofFIG. 17 in conjunction with the Internet-based shipping, tracking anddelivery network of the present invention shown in FIGS. 2, 4 and 6.

Upon generation of a trigger signal from the MICAP system, multipledigital images of package's shipping document are captured at differentimage resolutions, and then buffered in the memory storage of the MICAPsystem.

The MICAP system automatically processes the buffered digital images soas to read machine-readable information (e.g. shipper's shipmenttracking number, and optionally, detailed shipping information)graphically represented/encoded in the digital image of the originalshipping document, and produce symbol and character data representativethereof.

The MICAP system automatically encodes, as a tag, the symbol andcharacter data (i.e. shipper's shipment tracking number, and optionallymachine-recognized shipping information) into the EXIF header of thefile format (e.g. .pdf, .tiff, or other taggable file format) used toformat captured digital images for transmission. In additional to theabove tagging operation, the recognized shipment tracking number 17therein is used to title or name the produced image files 14. Forexample, if only one bar-coded number is recognized in the capturedimage, and its content was the number string “12345”, then the resultingimage would be named “12345.jpg”. At the same time, the bar-codedcontent “12345” would also be stored in the EXIF header of thejpg-formatted image file. Notably, in accordance with the presentinvention, all processes and services supported in the network aredriven from this recognition bar-coded content, and therefore, allimages of shipping manifests captured, processed and stored on thenetwork will be “referenced” directly through the 12345 number string,and related to other data in the RDBMS 15 describing the shipment.

At this stage of the process, the courier may use the Web-enabled mobiledata collection and communication terminal 110 to inspect and validatethe captured images and verify that he or she wants to retain them ordiscard them from memory, as discussed above in connection with thefirst illustrative embodiment of the MICAP system.

The bar-coded-tagged digital images are transmitted from the MICAPsystem to the remote image processing application servers (e.g. viahttp), for processing and storage in the RDBMS of the network.

At any time, the Web-enabled MICAP system can be used view the digitalimage of the shipping document stored in the RDBMS, and awaitingrecognition processing.

The Web-enabled MICAP system can be used to view the shipping statusinformation in the RDBMS, by reading bar codes or entering shipmentrelated information in the RDBMS of the network.

Notably, this embodiment of the present invention of the presentinvention can be readily modified such that it is mandated that theWeb-enabled MICAP system 20″ automatically generates electronic datafiles of captured digital images of shipping documents, which areencoded with both machine-recognized original shipment trackingnumber(s) as well as shipping information contained in the originalshipping document, while the electronic file is named or titled usingthe original shipment tracking number. In this modified embodiment, therole of the image processing application servers 21 on the network willbe to expedite the extraction of shipping information encoded with theheaders of received digital image files, and ultimately storing theextracted/recognized shipping information in the RDBMS on the network,while the pickup/delivery vehicle is transporting the package from itspoint of pickup to its first scanning point in the network. However, ifthe transmitted image file does not contain recognized shippinginformation (extracted from the original shipping document), due to afailure to recognize by the automatic form and character recognitionengine 53 at the point of pickup and image file transmission, then therole of image processing application servers 21 and human-operateddata-keying workstations 22 will be to expedite the processing of suchdigital images, the recognition of shipping information graphicallyencoded with received digital image files (e.g. employing automated formand character recognition processes, and/or human intelligence whenneeded), and ultimately storing the extracted/recognized shippinginformation in the RDBMS on the network.

Third Illustrative Embodiment of the Web-Based Mobile Image Capture andProcessing (MICAP) Subsystem of the Present Invention

FIG. 19 shows a third illustrative embodiment of the Web-enabled MICAPsystem of the present invention. As shown, the Web-enabled MICAP systemis realized in the form of a Web-enabled PC-based mobile cellphone 20′″having the capacity to capture and process digital images of shippingdocuments at the point of pickup, in accordance with the method of thepresent invention, and transmitting such digital image files to any oneor a number of cellphone base stations in the network (e.g. via awireless GSM, GPRS or EDGE type electromagnetic communication link),from which these image files are transmitted (over the TCP/IPinfrastructure of the Internet) to image processing application servers21 on the network, as shown in FIG. 4, 6 or 8.

As shown in FIG. 20, the Web-enabled mobile image capturing andprocessing cellphone 20′″ comprises, in a compact hand-supportablehousing: an integrated digital imaging engine 51 for digital imagecapture; an imaging-based bar code reading engine 52 for recognizing 1Dand/or 2D bar-coded labels in captured images; a form and characterstring recognition engine 53 for recognizing forms and alpha-numericcharacter strings within captured images; a touch-screen LCD panel 54with LCD controller 55A for enabling touch-screen data entry andapplication cursor control; LCD brightness control circuit 55B; amicroprocessor 56; program memory (DRAM) 57; non-volatile memory (SDRAM,hard-disc etc) 58; an RF I/O circuit 59; an RF antenna 61 coupled to aRF transceiver circuit 60 supporting Quad-band GSM, GPRS, EDGE, WiFI802.11g or 802.11n, and/or Bluetooth communication protocols; powersupply 62; trigger switch 63 for generating a trigger signal; arechargeable battery and a recharging circuit 64; system buses, a memorybridge, an I/O chipset, a visual display device, an audio displaydevice, an RFID tag reading engine and antenna 67, a manual data inputdevice, and the like. The microprocessor and memory architecture of themobile cellphone provides a computing platform supporting an operatingsystem (OS), such as Linux, OSX or Windows, and one or more applicationprograms, including a Web browser program, and a client applicationprogram (e.g. Java client program). The function of such clientapplication programs is to support (i) e-mail, SMS and IMS services,(ii) the client-side digital image capture, processing and transmissionfunctions of the present invention, as well as (iii) the client-serverbased image processing and information services supported on theserver-side of the network.

During operation on the network of the present invention, the Web-basedimage capturing and processing cellphone 20′″ is used to capture andprocess multiple-resolution color digital images of virtually anyshipping document, automatically recognize bar-coded shipment trackingnumbers (as well as detailed shipping information) graphicallyrepresented in such digital images, and automatically generatecompressed digital image files (i) encoded with machine-recognizedshipment tracking numbers (and optionally, detailed shippinginformation) within, for example, the EXIF file headers of the JPEGdigital image files, and/or (ii) named or titled using such recognizedshipment tracking numbers.

Method of Using the Web-Based MICAP System of Third IllustrativeEmbodiment in Conjunction with the Internet-Based Shipping, Tracking andDelivery Network of the Present Invention

FIG. 20 describes a method of using the Web-enabled MICAP system of FIG.18 in conjunction with the Internet-based shipping, tracking anddelivery network of the present invention shown in FIGS. 2, 4 and 6.

As illustrated at Block A in FIG. 20, upon generation of a triggersignal from the Web-enabled image capturing and processing cellphone20′″ (e.g. by the courier depressing a particular hardware ortouch-screen implemented trigger switch), multiple-resolution digitalimages of shipping document are automatically captured, and buffered inthe memory storage of the Web-enabled image capturing and processingcellphone.

As illustrated at Block B in FIG. 20, the mobile image capturing andprocessing cellphone 20′″ automatically processes the buffered digitalimages so as to read machine-readable information (e.g. shipper'sshipment tracking number 17, and optionally, the shipping information)graphically represented/encoded in the digital image of the originalshipping document, and produce symbol and character data representativethereof.

As illustrated at Block C in FIG. 20, Web-enabled image capturing andprocessing cellphone 20′″ automatically encodes, as a tag, the symboland character data (i.e. shipper's shipment tracking number 17, andoptionally, shipping information) into the EXIF header of the fileformat (e.g. .pdf, .tiff, or other taggable file format) used to encodethe captured digital images for transmission, storage and subsequent useon the network of the present invention. Also, the cellphone 20′″automatically names or titles the digital image files with themachine-recognized shipment tracking number.

As illustrated at Block D in FIG. 20, the bar-coded-tagged digital imagefiles 14 are transmitted from the Web-enabled image capturing andprocessing cellphone, to the network (image processing) applicationservers (e.g. via http), for extraction and/or recognition of shippinginformation and storage in the RDBMS of the network.

As illustrated at Block E in FIG. 20, the Web-browser enabled mobileimage capturing and processing cellphone 20′″ allows the courier (i.e.driver) to view the digital images of the shipping document stored inthe RDBMS, and awaiting processing.

As illustrated at Block F in FIG. 20, the Web-enabled image capturingand processing cellphone allows the courier to view the shipping statusinformation in the RDBMS, by reading bar codes or entering shipmentrelated information in the RDBMS of the network.

This embodiment of the present invention of the present invention can bereadily modified such that it is mandated that the Web-enabled imagecapturing and processing cellphone 20′″ automatically generateselectronic data files of captured digital images of shipping documents,which are encoded with both machine-recognized original shipmenttracking number(s) as well as shipping information contained in theoriginal shipping document, while the digital image file is named ortitled using the shipment tracking number. In this modified embodimentof the Web-enabled image capturing and processing cellphone 20′″, therole of the network image processing application servers 21 are toexpedite the extraction and/or recognition of shipping informationencoded with the headers of received digital image files, and ultimatelystoring the extracted and/or recognized shipping information in theRDBMS on the network, while the pickup/delivery vehicle is transportingthe package from its first point of pickup to its first scanning point(i.e. pickup and delivery terminal or sorting and routing hub) in thenetwork. If the transmitted image file does not contain recognizedshipping information (extracted from the original shipping manifest),due to a failure to recognize by the automated form and characterrecognition engine 53 at the point of pickup, then the role of networkimage processing application servers 21 and/or human-operateddata-keying workstations 22 will be to expedite the processing of suchdigital images, the recognition of shipping information graphicallyencoded with received digital image files (e.g. employing automated formand character recognition processes, and/or human intelligence whenneeded), and ultimately storing the extracted and/or recognized shippinginformation in the RDBMS on the network.

Implementation and Deployment of the Internet-Based Shipping, Trackingand Delivery Network of the Present Invention

In practice, the web-based shipping, tracking and delivery network ofthe present invention will be realized as an industrial-strength,carrier-class Internet-based communications network of object-orientedsystem design, deployed on the global data packet information networkcomprising numerous information subsystems and systems and networkcomponents, as shown in the figures drawings.

Preferably, the Web-based and other information services associated withthe web-based shipping, tracking and delivery network of the presentinvention will be designed according to object-oriented systemsengineering (OOSE) methods using UML-based modeling tools such as ROSEby IBM Rational Software, or Borland Together Technologie™ by BorlandSoftware, using the industry-standard Rational Unified Process (RUP) orthe Enterprise Unified Process (EUP), both well known in the art ofobject-oriented systems engineering, and deployment. In general,Web-based shipping, Tracking And Delivery Network of the presentinvention can be implemented on any Java-based object-orientedintegrated development environment (IDE) such as WebObjects 5.2 by AppleComputer Inc, Websphere IDE by IBM, or Weblogic IDE by BEA, or even annon-Java IDE such as Microsoft's .NET IDE. Two different networkimplementations using the WebObjects IDE are illustrated in FIGS. 21Aand 21B using Web-based and Java-client technology, respectively.

A three-tier server architecture with a double-firewall would provide apreferred deployment platform for the Web-based network of the presentinvention. Typically, the Web servers 14 will be realized as a clusterof HHTP servers (nodes) running multiple instances of http serversoftware, such as Apache HHTP server, on top of the server's operatingsystem (OS), in a manner known in the art. The Java application servers21′, 21″ will also be realized as a cluster of servers (nodes) runningJava Application Server software, upon a Java Virtual Machine (JVM), ontop of the server's operating system (OS), in a manner well known in theart. Similarly, the database (RDBMS) server 15 will also be realized asa cluster of database servers running an industrial strength RDBMSsoftware such as Oracle RDBMS 10g from Oracle Corporation, DB2 RDBMSfrom IBM, PostgresSQL RDBMS from PostgreSQL Global Development Group, orthe like, on the server's operating system (OS), also in a manner knownin the art.

In addition to typical Web, application and database server requirementsfor practicing the network and methods of the present inventiondescribed above, a typical network implementation will include hundredsof pick-up and delivery terminals, and dozens of sorting and routing hublocations across the globe. Consequently, the information technology(IT) division responsible for the network will need to support overhundreds of remote locations, and thousands of employees. A primaryobjective of this IT group will be to ensure that all data andtelecommunications services required for mission-critical, 24-hour-a-dayoperations are up and available over the network.

In order to provide high processing power across the network, formaximum performance and the ability to connect satellite and ISDN backupnetworks, the network's deployment platform might use the Cisco®Catalyst® 6509 Switch and Cisco 3845 Integrated Services Router. Forsmaller sites across the network, three separate network segments mightbe used. For example, the first segment might be realized using a Cisco2811 Integrated Services Router having maximum CPU power, for performingstraight routing functions. The second segment might include a CiscoCatalyst Switch, such as a Catalyst 2950 Switch, for forming the mainEthernet network in the facility. The third segment may include aCatalyst 3560 or 3750 switch with Power over Ethernet (PoE) for poweringradio frequency (RF) wireless access points. Several Cisco Catalyst 3750switches can be stacked together for added redundancy, simplifyingmanageability, and reducing the number of IP addresses required.

All equipment would run the latest version of Cisco IOS® Software.Larger sites might include dual redundant Cisco Catalyst 6509 switchesas a network core, and dual Cisco 3845 integrated services routers withdata and voice features implemented. Some locations may also have ISDN,satellite, or cellular backup networks for emergency use. The dual CiscoCatalyst 6509 switches can be configured with high-density, 10-GigabitEthernet modules for high scalability and intelligent multilayerswitching performance. Redundant Catalyst 6500 Series Supervisor Engine720s can be configured with Cisco nonstop forwarding (NSF) and statefulswitchover (SSO) to provide maximum uptime with redundancy and rapidtwo-to-three-second failover. Cisco 3845 integrated services routers candeliver wire-velocity performance for concurrent services such as dataand voice. Dual Cisco 3845 integrated services routers can be deployedat each large site configured with Hot Standby Routing Protocol (HSRP)for redundancy.

Each ground-based facility in the network can deploy a wireless RFcommunication application that runs over a subnetwork (system) thatemploys the 802.11g or 802.11n standard access ports and managed by athird-party computer system. These systems can receive power from CiscoCatalyst 3560 switches.

When a courier (i.e. driver) picks up a shipment, the MICAP system ofthe present invention aboard each vehicle will send digital images ofshipping documents (e.g. manifests, air bills, etc) to the imageprocessing application servers 21 at the data collection and processingcenter, or elsewhere on the network, using either GRPS, EDGE, GSM,802.11g, or 802.11n communication services, and the data packetsassociated with these digital images received through access ports whichcan be powered by Cisco Catalyst 3560 switches. These and othernetworking details will readily occur to one skilled in theinternetworking art, having the benefit of the present inventiondisclosure.

Modifications that Come to Mind

While the illustrative embodiments of the present invention have beendescribed in connection with package shipping, tracking and deliverynetworks involving the use of 1-D and 2-D bar code structures to encodeshipment tracking numbers and the like, it is understood that thepresent invention can practiced using any machine-readable indicia,dataform, or graphically-encoded form of intelligence, including, butnot limited to bar code symbol structures, alphanumeric characterrecognition strings, handwriting, and diverse dataforms currently knownin the art or to be developed in the future. Hereinafter, the term “barcode symbol” and “bar-coded” shall be deemed to include all suchinformation carrying structures and other forms of graphically-encodedintelligence.

It is understood that the image capture and processing technologyemployed in systems and networks of the illustrative embodiments may bemodified in a variety of ways which will become readily apparent tothose skilled in the art of having the benefit of the novel teachingsdisclosed herein. All such modifications and variations of theillustrative embodiments thereof shall be deemed to be within the scopeand spirit of the present invention as defined by the Claims toInvention appended hereto.

1. A method of rapidly translating an original shipping document regarding one or more shipment items being shipped, tracked and delivered to a final destination using a Web-based shipping, tracking and delivery information network having a first scanning point, subsequent scanning points, one or more digital image processing application servers and a shipping information relational database management system (RDBMS), said method comprising the steps of: (a) at a point of shipment pickup, capturing a digital image of an original shipping document in connection with a shipment, and generating a corresponding digital image file having a header and a name; wherein said original shipping document contains shipping information and is indexed with an original bar-coded shipment tracking number; (b) automatically reading the original bar-coded shipment tracking number graphically represented in said original shipping document and generating a character data string representative of said original bar-coded shipment tracking number; (c) automatically encoding said character data string into the header and/or name of said corresponding digital image file; (d) while the shipment is being delivered to the first scanning point in said Web-based shipping, tracking and delivery network, transmitting said digital image file over a wireless communication link to said one or more digital image processing application servers, and processing said digital image so that shipping information contained in said digital image is automatically abstracted/recognized, and loaded into said shipping information RDBMS maintained on said Web-based shipping, tracking and delivery network; (e) when the shipment arrives at said first scanning point, reading the original bar-coded shipment tracking number, and using said original bar-coded shipment tracking number to access corresponding shipping information maintained in said shipping information RDBMS; (f) automatically generating a unique network-assigned shipping label for said shipment; and (g) applying said unique network-assigned shipping label to the shipment items of said shipment at said first scanning point, for use in managing future services supported on said network.
 2. The method of claim I, wherein (a) at said first scanning point, reading the original bar-coded shipment tracking number contained in said original shipping document using an optical scanning device or an imaging-based bar code reading device, so as to access shipping information stored in said shipping information RDBMS corresponding to the shipment.
 3. The method of claim 1, wherein step (f) comprises generating said unique network-assigned shipping label provided with a 2D bar-coded label encoded with a unique network-assigned shipment tracking number as well as shipping information abstracted from said original shipping document; and step (g) comprises applying said unique network-assigned shipping label to the shipment items of said shipment; and after step (f), at subsequent scanning points in said Web-based shipping, tracking and delivery network, reading the 2D bar-coded label so as to access shipping information encoded therein and sort and route the shipment through said Web-based shipping, tracking and delivery network to its destination indicated by the shipping information contained in said 2D bar-coded label.
 4. The method of claim 1, wherein step (f) comprises generating said unique network-assigned shipping label provided with a 1D bar-coded label encoded with an unique network-assigned shipment tracking number, and step (g) comprises applying said unique network-assigned shipping label to the shipment items of said shipment; and after step (f), at subsequent scanning points, reading the shipment tracking number contained in said unique network-assigned shipping label, accessing said shipping information RDBMS and using shipping information stored in said shipping information RDBMS to sort and route the shipment through said Web-based shipping, tracking and delivery network to said final destination indicated in said shipping information RDBMS.
 5. The method of claim 1, which further comprises after step (g), (h) using shipping information stored in said shipping information RDBMS so as to sort and route the shipment through said Web-based shipping, tracking and delivery network to said final destination indicated in said shipping information RDBMS.
 6. The method of claim 1, wherein said shipping document comprises a shipping label.
 7. The method of claim 1, wherein said one or more digital image processing application servers include at least one human-operated workstation allowing a human being to view said captured digital image of said original shipping document and assist in the recognition of shipping information graphically represented therein. 